Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
INFORMATION OUTPUT DEVICE, MEDIUM, AND INFORMATION INPUT/OUTPUT DEVICE
Document Type and Number:
WIPO Patent Application WO/2007/021249
Kind Code:
A3
Abstract:
To achieve an information output device in which information of a medium disposed on a stage surface can be surely and efficiently read out, and a stage effect and a security are high. In the information output device, media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units, and information corresponding to the code values or the coordinate values is outputted. Further, light transmitting reading holes are respectively provided at a plurality of medium disposing locations on the stage surface, and the imaging units are disposed in the space below the stage corresponding the respective reading holes such that the imaging units photograph the medium surfaces of the media disposed on the reading holes.

Inventors:
YOSHIDA, Kenji (9-14-2302, Koishikawa 1-chome Bunkyo-ku, Tokyo 02, 1120002, JP)
Application Number:
SG2006/000219
Publication Date:
February 22, 2007
Filing Date:
August 02, 2006
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
GRID IP PTE. LTD. (6 Temasek Boulevard, 29th Floor Suntec Tower Four, Singapore 6, 03898, SG)
YOSHIDA, Kenji (9-14-2302, Koishikawa 1-chome Bunkyo-ku, Tokyo 02, 1120002, JP)
International Classes:
G06F3/042; A63F1/00; A63F1/02; A63F3/02; A63F13/00; A63F13/08; G06K19/06; G06K19/08; H04N1/195
Domestic Patent References:
1984-05-24
2004-05-21
Foreign References:
EP1319430A12003-06-18
JP2004337502A2004-12-02
US20050128551A12005-06-16
Attorney, Agent or Firm:
KELVIN CHIA PARTNERSHIP (6 Temasek Boulevard, 29th Floor Suntec Tower Four, Singapore 6, 03898, SG)
Download PDF:
Claims:

CLAIMS

1. An information output device in which n.edia are disposed on a stage surface in & state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging unLts, and information corresponding to the code values pr the coordinate values is outputted, wherein light transmitting reading holes are respectively provided at a plurality of medium disposing locations on the stage surface, and the imaging units are disposed in the space t:elow the stage corresponding the respective reading holes suet that the imaging units photograph the medium surfaces of the media disposed on the reading holes.

2. An information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or

coordinate values indicating the dot patterns from photographed images obtained by the imaging units, and information corresponding to the code values or the coordinate values is outputted, wherein the stage surface has a plurality of medium disposing locations, reading regions are respectively formed at the medium disposing locations, the reading regions where the dot patterns of the media surfaces disposed so as to be opposite to the stage surface are read by using the imaging units that are disposed in the space below the stage, and a characteristic ink for transmitting infrared rays is printed on the stage surface.

3. The information output device according to claim 2, wherein a characteristic ink that does not transmit infrared rays is printed on the stage surface, and a characteristic ink that transmits the infrared rays is printed on only the reading regions.

4. The information output device according to claim 3, wherein a general-purpose ink, which is made of CMY inks not containing a carbon component and a K ink containing the carbon component, is printed on the stage surface, and printing, which falsely reproduces a K component by using only CMY inks not containing a carbon component, is performed on only the reading regions.

5. An information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units, and information corresponding to the code values or the coordinate values is outputted, wherein the stage surface has a plurality of medium disposing locations, reading regions are respectively formed at the medium disposing locations, the reading regions where dot patterns of the medium surfaces disposed so as to be opposite to the stage surface are read by using the imaging units that are disposed in the space below the stage, and an upper layer of the stage surface is composed of a transparent plate, IR filters that transmit wavelength light of infrared ray regions of infrared ray irradiating units disposed in a space below the stage are provided at locations corresponding to at least the reading regions of a lower layer of the stage surface.

6. The information output device according to claim 5, wherein a color filter is provided on a region other than

the reading regions or an entire surface.

7. An information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface,- the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units are converted into, and information corresponding to the code values or the coordinate values is outputted, wherein in the space below the stage, at locations that avoid imaging light irradiated onto a bottom surface of the stage by the imaging units, light irradiation light sources that irradiate irradiated light onto the dot patterns of the medium surfaces on the stage surface, and a dispersion filter that disperses the irradiated light by the light irradiation light source into the bottom surface of the stage are provided.

8. The information output device according to claim 7, wherein the dispersion filter is composed of a frame that protrudes in an inward direction of sidewalls that define the space below the stage.

9. A medium in which predetermined irradiated light is irradiated onto at least medium surfaces by imaging units, dot patterns printed on the medium surfaces are optically

photographed by reading reflective light by the imaging units and converted into code values or coordinate values indicating the dot patterns from the imaging units, and information corresponding to the code values or the coordinate values is outputted to an information output device, wherein the medium surface is divided into regions where two or more of dot patterns indicating at least two or more of different code values or coordinate values are printed.

10. The medium according to claim 9, wherein the medium is a playing card, and at least one surface of the playing card is divided into two or more of code regions, such that dot patterns are printed.

11. The medium according to claim 9, wherein on one surface of the playing card, dot patterns capable of detecting a direction of the card on the stage surface are printed.

12. The medium according to claim 10 or 11, wherein the medium is a playing card, and any one of a RFID tag, a magnetic storage unit, and a memory composed of an IC chip is built in the medium.

13. An information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in

a space below the stage, code values indicating the dot patterns and directions of the media obtained from the analyzed result of the dot patterns are calculated from photographed images obtained by the imaging units and locations of the media disposed on the stage surface defined by XY coordinates are calculated, and information corresponding to the calculation results is outputted.

14. The information output device according to claim 13, wherein the imaging unit detects brightness of a checking pixel group set at a predetermined interval among pixel matrices of the predetermined number, determines that the medium is disposed on the pixel matrix, when the brightness is equal to or greater than a predetermined threshold value, and code analysis of dot patterns is performed with respect to only a pixel matrix group that has been determined that the medium is disposed.

15. An information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by an imaging unit disposed in a space below the stage, code values indicating the dot patterns and directions of the media obtained from the analyzed result of the dot patterns are calculated from photographed images obtained by the imaging unit and locations of the media

disposed on the stage surface defined by XY coordinates are calculated, and information corresponding to the calculated results is outputted, wherein in the space below the stage, a projection unit is disposed, in addition to the imaging unit, and the projection unit controls images or moving pictures projected on the stage surface by calculating the code values of the dot patterns obtained from the photographed images by the imaging unit and the direction of the card obtained from the analyzed results of the dot patterns and calculating the location of the medium disposed on the stage surface defined by XY coordinates.

16. The information output device according to claim 15, wherein an upper layer of the stage is composed of a transparent plate, and a lower layer of the stage is composed of a projection sheet for a projection unit.

17. The information output device according to claim 15 or 16, wherein in the space below the stage, at locations that avoid projected light from the projection unit to the stage surface, light irradiation light sources that irradiate irradiated light onto the dot patterns of the medium surface on the stage surface, and a dispersion filter that disperses the irradiated light of the light irradiation light source into

the bottom surface of the stage are provided.

18. The information output device according to claim 15, wherein a magic mirror is obliquely provided in the space below the stage, a projection unit is disposed at one surface side of the magic mirror, projection images or moving pictures from the projection unit are reflected on the one surface to be projected onto the stage surface, and an imaging unit is disposed on the other surface side of the magic mirror, and photographed light of the dot patterns of the medium surface on the stage surface transmits the magic mirror to be incident on the imaging unit.

19. The information output device according to claim 15, wherein mirrors are obliquely provided in the space below the stage, a projection unit and an imaging unit are disposed on one surface side of the mirror, and projection images or moving pictures from the projection unit are reflected on the one surface to be projected onto the bottom surface of the stage.

20. An information output device in which an illumination unit irradiates irradiation light onto a medium where dot patterns to be reactive with predetermined irradiation light are printed, reflected light is read by an imaging unit, photographed images obtained by the imaging unit

are converted into code values or coordinate values indicating the dot patterns, and information corresponding to the code values or the coordinate values is outputted, wherein the imaging unit selectively or- overlappingly reads one system or a plurality of systems of dot patterns among two systems or more of dot patterns formed by at least two kinds of inks having different reactivity printed on the medium so as to be converted into code values or coordinate values.

21. An information output device in which an illumination unit irradiates irradiation light onto a medium where dot patterns to be reactive with predetermined irradiation light are printed, reflected light is read by an imaging unit, code values indicating dot patterns and the direction of the medium obtained from the analyzed result of the dot patterns from the photographed images obtained by the imaging unit are calculated and the location of the medium disposed on the stage surface defined by XY coordinates is calculated, and information according to the calculated result is outputted, wherein the imaging unit selectively or overlappingly reads one system or a plurality of systems of dot patterns among two systems or more of dot patterns formed by at least two kinds of inks having different reactivity printed on the medium so as to be converted into code values or coordinate values.

22. The information output device according to claim

20 or 21 , wherein the irradiation light is an infrared ray, and the at least two kinds of inks having different reactivity are two kinds of inks that have different infrared ray absorptivity with respect to all frequency bands, respectively.

23. The information output device according to claim 20 or 21, wherein the irradiation light is an infrared ray, and the at least two kinds of inks having the different reactivity are two kinds of inks that have different peak value wavelength characteristic of infrared ray absorptivity, respectively.

24. The information output device according to claim 20 or 21, wherein the irradiation light is an infrared ray, and the at least two kinds of inks having the different reactivity are two kinds of inks that have different peak value wavelength characteristic of infrared ray absorptivity, respectively, and the irradiation unit has two or more of irradiation sections, each of which adjusts an infrared wavelength for each different peak value of infrared ray absorptivity.

25. The information output device according to claim 20 or 21, wherein the irradiation light is an infrared ray, and the at least two kinds of inks having different reactivity are

respectively a first ink and a second ink, the first ink having a small peak value of infrared ray absorptivity and a small wavelength, the second ink having a large peak value of infrared ray absorptivity and a large wavelength, the irradiation unit has a first irradiation unit and a second irradiation unit, the first irradiation unit having wavelength characteristic of almost an entire region of an infrared wavelength, the second irradiation unit being suitable for a wavelength in which the infrared absorptivity of the first ink is larger than the infrared absorptivity of the second ink, and the first and second irradiation units selectively or overlappingly irradiate irradiation light onto the medium, and the reading unit selectively or overlappingly reads a first dot pattern printed by the first ink or a second dot pattern printed by the second ink.

26. A medium in which predetermined irradiation light is irradiated onto at least a medium surface by an imaging unit, dot patterns printed on the medium surface are optically photographed by reading reflective light by the imaging unit and converted into code values or coordinate values indicating the dot patterns from the photographed images, and information corresponding to the code values or the coordinate values is outputted to the information output device, wherein two systems of dot patterns that are formed by

at least two kinds of inks having different reactivity with respect to the predetermined irradiated light are printed on the medium surface .

27. A medium in which predetermined irradiation light is irradiated onto at least a medium surface by an imaging unit, dot patterns printed on the medium surface are optically photographed by reading reflective light by the imaging unit, code values indicating the dot patterns and directions of the medium obtained from the analyzed result of the dot patterns are calculated from the photographed images and the location of the medium disposed on the stage surface defined by XY coordinates is calculated, and information according to the calculated results is outputted to an information output device, wherein two systems of dot patterns that are formed by at least two kinds of inks having different reactivity with respect to the predetermined irradiated light are printed on the medium surface.

28. The medium according to claim 26 or 27, wherein the irradiation light is an infrared ray, and the at least two kinds of inks having the different reactivity are two kinds of inks that have different infrared ray absorptivity, respectively.

29. The medium according to claim 26 or 27, wherein the irradiation light is an infrared ray, and

the at least two kinds of inks having the different reactivity are two kinds of inks that have infrared wavelengths, respectively.

30. The medium according to any one- of claims 26, 27, 28, and 29, wherein the medium is a playing card.

31. The medium according to claim 30, wherein any one of a RFID tag, a magnetic storage unit, or a memory composed of an IC chip is built in the playing card.

32. The medium according to any one of claims 26, 27, 28, and 29, wherein the medium is a counterfeit preventing subject medium, such as a seal, a tag, a certificate (an identification certificate and a passport) , an exchange ticket for money, and a ticket.

33. The medium according to claim 32, wherein an RFID tag is built in the counterfeit preventing subject medium.

34. An information input/output device in which medium surfaces of a plurality of media where code information indicating characters or numerical values, such as the characters, pictures, two-dimensional codes, and the like, or numerical values are printed by ink having infrared ray absorbing characteristic are disposed on a stage surface transmitting infrared rays in a state in which the media

surfaces are opposite to the stage surface, infrared rays are irradiated onto a bottom surface of the stage by an infrared ray irradiating unit provided at an inner circumference of the space below the stage surface, reflected light is photographed by an infrared ray imaging unit, and an information processing unit for outputting multimedia information, such as sounds, characters, images, moving pictures, and the like, on the basis of photographed images obtained from the infrared ray imaging unit, is provided, wherein on the basis of projection images from the infrared ray imaging unit, the information processing unit inputs positional information of a medium on the stage surface, direction information or medium state information indicating a contact state between the stage surface and the medium, and code information printed on the medium surface, and the information processing unit outputs and displays the medium state information and multimedia information, such as characters, images, moving pictures, and the like, corresponding to the code information, to and on an entire surface or a portion of the stage surface composed of a projection panel with respect to the projection unit disposed below the stage surface.

35. The information input/output device according to claim 34, wherein the multimedia information is information that

indicates medium arrangement on the projection panel surface and an operation instruction.

36. The information input/output device according to claim 34, wherein the code is a dot pattern.

37. The information input/output device according to claim 34, wherein pictures or characters are printed on a portion and all of a top surface of the projection panel by using an infrared ink or an infrared ray transmitting sheet printed by the infrared ray transmitting ink is attached to the portion and all of the top surface of the projection panel.

38. The information input/output device according to any one of claims 34 to 37, wherein a frame designating a projection region for projecting light by the projection unit or marks designating four corners of the projection region are printed on the top surface of the projection panel or the infrared ray transmitting sheet according to claim 37 by using visible infrared ray transmitting ink, or a removable infrared ray transmitting sheet printed by the ink is attached, and the information processing unit allows the projection unit to project a frame indicating a projection region or marks indicating four corners of the projection region onto the projection panel, and corrects a visibly designated projection

region and a projection region of the projection image to be equal to each other.

39. The information output device according to any one of claims 34 to 38, wherein dot marks designating four corners of a region photographing an infrared image are printed by using an infrared ray absorbing ink on the top surface of the projection panel, or a removable infrared ray transmitting sheet printed by the ink is attached, and the information processing unit recognizes coordinates of the four corners on the basis of the dot marks photographed by the infrared ray imaging unit, determines whether the coordinates are at the same locations as information of four corners of the photographic regions previously stored in a storage unit, and displays the result information and instruction information on the projection panel by the projection unit.

40. The information input/output device according to claim 34, wherein the information processing unit outputs to the projection unit information indicating characters, diagrams, images or moving pictures that are associated with the medium disposed on the surface of the projection panel.

41. The information input/output device according to claim 40,

wherein the information processing unit outputs to the projection unit information indicating characters, diagrams, images or moving pictures associated with the medium to locations the projection panel surface- that do not overlap a contact surface of the medium.

42. The information input/output device according to any one of claims 34 to 41, wherein medium information indicating a kind and a shape of the medium or a shape of the medium surface is defined in the code information printed on the printing surface, and information indicating characters, diagrams, images or moving pictures projected onto the projection panel surface is created on the basis of the medium information.

43. The information input/output device according to claim 34, wherein the information processing unit detects an operation of the medium that operates by a user on a stage surface on the basis of state information of the medium, and after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the projection panel, the information processing unit recognizes a grid tapping operation of the medium on the projection panel, that is, reads XY coordinate information calculated in

substantially the same region as the location where the medium is disposed in a predetermined time or a designated region and/or code information many times to recognize the XY coordinates and the code information.

44. The information input/output device according to claim 34, the information processing unit detects an operation of the medium that operates by a user on a projection panel on the basis of state information of the medium, and after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, and the information processing unit performs a grid twist operation that rotates the medium on the basis of any location of the medium surface on the projection panel surface, such that a rotation angle of the medium or traces of the rotation angle with respect to the direction of the imaging unit are repeatedly recognized in a predetermined time.

45. The information input/output device according to claim 34, wherein the information processing unit detects an operation of the medium that operates by a user on a the projection panel surface on the basis of state information of the medium, and

after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, and the information processing unit performs a circular grid sliding operation of the medium surface on the projection panel surface, such that traces of the XY information calculated in a predetermined time is recognized as a substantially circular shape .

46. The information input/output device according to claim 34, wherein the information processing unit detects an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium, and after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, and the information processing unit performs a straight-line-shaped grid scrolling operation of the medium on the projection panel surface, such that traces of the XY coordinate information calculated in a predetermined time is recognized as a substantially straight line shape.

47. The information input/output device according to

claim 34 , wherein the information processing unit detects an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium, and after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, and the information processing unit performs a grid scratching operation of the medium repetitively in a straight line shape on the projection panel surface, such that it is recognized that traces of the XY information calculated in a predetermined time is repeated in a substantially straight line shape.

48. The information input/output device according to claim 34, wherein the information processing unit detects an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium, and after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, and

the information processing unit performs a grid tilting operation of inclining the medium on the projection panel surface, such that a variation of inclination of the medium with respect to a vertical line of the projection panel in a predetermined time is recognized.

49. The information input/output device according to claim 34, wherein the information processing unit detects an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium, and after the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the projection panel surface, and the information processing unit performs a grid turnover operation of turning over a portion of the medium surface on the projection panel surface, such that a variation of an area ratio of the medium surface turned over from the projection panel surface in a predetermined time is recognized.

50. The information input/output device according to claim 48 or 49, wherein the information processing unit performs the operation of the medium according to claim 48 or 49, such that characters, diagrams, images or moving pictures corresponding

to the code information are projected onto a region of the projection panel surface from which the medium surface is turned over, by means of the projection unit.

51. The information input/output device according to claim 48 or 49, wherein the inclination according to claim 48 or the area ratio according to claim 49 is recognized by brightness of the infrared image obtained by photographing a region where the medium is turned over the stage surface, by means of the imaging unit.

52. The information input/output device according to any one of claims 43 to 49, wherein the operation of the medium according to any one of claims 43 to 49 is based on the recognition of the number of times or speed of the operation repeated in a predetermined time.

53. The information input/output device according to claims 43 to 52, wherein the operation of the medium according to any one of claims 43 to 52 is based on a history stored in a storage unit.

54. An information output device in which a medium is disposed on a stage surface in a state where the medium is opposite to the stage surface, the medium where dot patterns are printed on a medium surface on the basis of a predetermined

rule, the dot patterns are read by an imaging unit disposed in a space below the stage, code values indicating the dot patterns and directions of the media obtained from the analyzed result of the dot patterns are calculated from photographed images obtained by the imaging unit and locations of the media disposed on the stage surface defined by XY coordinates are calculated, and information corresponding to the calculated results is outputted, wherein the imaging unit detects brightness of each pixel or a pixel group among pixel matrices of the predetermined number, and recognizes a shape of the medium on the basis of a pixel or a pixel group whose brightness is equal to or more than a previously set threshold value.

55. The information output device according to claim 54, wherein the recognized medium is a card.

56. The information output device according to claim 54, wherein the recognized medium is a fingertip of an operator or a player.

57. The information output device according to any one of claims 54 to 56, wherein the centroid of the medium is calculated by a medium shape recognizing image from the imaging unit, and an operation corresponding to coordinates of the centroid is

performed.

Description:

DESCRIPTION

INFORMATION OUTPUT DEVICE, MEDIUM, AND INFORMATION INPUT/OUTPUT DEVICE

Technical Field [0001] The present invention relates to a card game machine.

Background Art

[0002]

Generally, in arcade game machines disposed on a game center or the like or 'game machines used in a state in which they are connected to household television monitors, card game machines are known in which cards are disposed on stages of the game machines and a card game is performed (for example, see Patent Document 1) .

[0003]

Further, a game machine has been suggested in which information about a game, such as numeric values of cards disposed on a stage by a player or the game result, is displayed as images on the stage by using a projector (for example, see Patent Document 2) .

Patent Document 1: JP-A-2005-46649

Patent Document 2: JP-A-2002-102529

Disclosure of the Invention

Problem that the Invention is to Solve

[0004]

However, in the game machine disclosed in Patent Document

1, only one camera is provided in a casing of the game machine, and thus a variety of information, such as directions or coordinates of cards, different codes, and the like, cannot be precisely read.

[0005]

Further, in the game machine disclosed in Patent Document

2, a column support is provided in a casing of the game machine in which a stage on which cards are disposed is provided, and a display device, such as a projector, is disposed on the column support, which results in increasing a size in a device. Therefore, it is difficult for the game machine to be disposed in the game center.

[0006]

Accordingly, in order to solve the above-mentioned problems, an object of the invention is to provide an information output device in which information of a medium disposed on a stage surface can be surely and efficiently read and a stage effect and security are high.

Means for Solving the Problem

[0007]

In order to achieve the above-mentioned object, the invention adopts the following units.

[0008]

According to a first aspect of the invention, there is provided an information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units, and information corresponding to the code values or the coordinate values is outputted. Further, light transmitting reading holes are respectively provided at a plurality of medium disposing locations on the stage surface, and the imaging units are disposed in the space below the stage corresponding the respective reading holes such that the imaging units photograph the medium surfaces of the media disposed on the reading holes.

[0009]

In this case, the medium refers to, for example, a card or a figure, and the medium surface refers to, for example, one surface of the card or a bottom surface of a seat of the

figure. The medium is not limited to the card or the figure, but may be a seal, a tag, a certificate (an identification certificate and a passport) , an exchange ticket for money, a ticket, and the like. [0010]

As the information output device, an arrangement-type card game machine may be exemplified. In the card game machine, a top surface is constructed as a stage, and the medium, such as the card, the figure, and the like, is disposed at a predetermined location (reading region) of the stage. As a result, the card game machine (information output device) reads the dot patterns formed on the medium surface of the card or the figure, determines the game result between the players or between the player and the information output device, and progresses the game. [0011]

According to the first aspect of the invention, the cameras are provided at locations of the space below the stage, and thus the dot pattern of each medium can be surely read out. [0012]

According to a second aspect of the invention, there is provided an information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined

rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units, and information corresponding to the code values or the coordinate values is outputted. The stage surface has a plurality of medium disposing locations, reading regions are respectively formed at the medium disposing locations, the reading regions where the dot patterns of the media surfaces disposed so as to be opposite to the stage surface are read by using the imaging units that are disposed in the space below the stage, and a characteristic ink for transmitting infrared rays is printed on the stage surface. [0013]

According to a third aspect of the invention, in the information output device according to the second aspect of the invention, a characteristic ink that does not transmit infrared rays may be printed on the stage surface, and a characteristic ink that transmits the infrared rays may be printed on only the reading regions. [0014]

According to a fourth aspect of the invention, in the information output device according to the third aspect of the invention, a general-purpose ink, which is made of CMY inks not containing a carbon component and a K ink containing the

carbon component, may be printed on the stage surface, and printing, which falsely reproduces a K component by using only CMY inks not containing a carbon component, may be performed on only the reading regions .

[0015]

In the information output device according to the second to fourth aspects of the invention, in at least the reading regions, an ink having characteristic that can transmit the infrared ray is used. For example, in the stage surface, general CMY inks that do not contain the carbon, and a K ink that contains the carbon are used, and in the reading regions, the printing is performed by using only the CMY ink that does not contain the carbon. In the reading regions, a K component is represented by only the CMY inks with carbon not contained without using the K ink, such that the reading region cannot be recognized from the stage surface. As a result, the printing can be performed by using only a low-priced general ink (CMY inks that do not contain the carbon, and a K ink that contains the carbon) .

[0016]

If the infrared component of the external light permeates into an inner portion of the game machine, a noise may occur when the dot pattern is read. However, as described above, the substantially entire surface of the stage surface is allowed to have an infrared ray non-transmission property, and

only the reading regions are allowed to have an infrared ray transmitting property. As a result, it is possible to reduce the noise.

[0017]

According to a fifth aspect of the invention, there is provided an information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units, and information corresponding to the code values or the coordinate values is outputted. Further, the stage surface has a plurality of medium disposing locations, reading regions are respectively formed at the medium disposing locations, the reading regions where dot patterns of the medium surfaces disposed so as to be opposite to the stage surface are read by using the imaging units that are disposed in the space below the stage, and an upper layer of the stage surface is composed of a transparent plate, IR filters that transmit wavelength light of infrared ray regions of infrared ray irradiating units disposed in a space below the stage are provided at locations corresponding to at least the reading regions of a lower layer

of the stage surface.

[0018]

According to a sixth aspect of the invention, in the information output device according to the fifth aspect of the invention, a color filter may be provided on a region other than the reading regions or an entire surface.

[0019]

In this case, the IR filter refers to an optical filter that can transmit only an infrared wavelength (700 nm or more) among the optical components.

[0020]

According to the fifth and sixth aspects of the invention, the IR filter is provided below the stage surface, and thus the information output device can be constructed without providing the IR filter in an individual infrared ray- irradiating unit or an imaging unit in the space below the stage. Further, the IR filter or the color filter is provided, such that the inner space below the stage can be made not to be viewed from the upper side of the stage surface.

[0021]

According to a seventh aspect of the invention, there is provided an information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined

rule, the dot patterns are read by imaging units disposed in a space below the stage and converted into code values or coordinate values indicating the dot patterns from photographed images obtained by the imaging units are converted into, and information corresponding to the code values or the coordinate values is outputted. Further, in the space below the stage, at locations that avoid imaging light irradiated onto a bottom surface of the stage by the imaging units, light irradiation light sources that irradiate irradiated light onto the dot patterns of the medium surfaces on the stage surface, and a dispersion filter that disperses the irradiated light by the light irradiation light source into the bottom surface of the stage are provided. [0022]

According to an eighth aspect of the invention, in the information output device according to the seventh aspect of the invention, the dispersion filter may be composed of a frame that protrudes in an inward direction of sidewalls that define the space below the stage. [0023]

As such, at the locations where the imaging light is avoided from the bottom surface of the stage, light irradiation light sources that irradiate light on the dot pattern of the medium surface on the stage surface, and a dispersion filter that disperses the irradiated light by the light irradiation

light source on the bottom surface of the stage are provided, and the irradiation light can be efficiently irradiated onto the bottom surface of the stage. Further, the dispersion filter is provided in a frame shape, and the installing structure can be simplified.

[0024]

According to a ninth aspect of the invention, there is provide a medium in which predetermined irradiated light is irradiated onto at least medium surfaces by imaging units, dot patterns printed on the medium surfaces are optically photographed by reading reflective light by the imaging units and converted into code values or coordinate values indicating the dot patterns from the imaging units, and information corresponding to the code values or the coordinate values is outputted to an information output device. The medium surface is divided into regions where two or more of dot patterns indicating at least two or more of different code values or coordinate values are printed.

[0025]

According to a tenth aspect of the invention, in the medium according to the ninth aspect of the invention, the medium may be a playing card, and at least one surface of the playing card may be divided into two or more of code regions, such that dot patterns are printed.

[0026]

According to an eleventh aspect of the invention, in the medium according to the ninth aspect of the invention, on one surface of the playing card, dot patterns capable of detecting a direction of the card on the stage surface may be printed.

[0027]

According to a twelfth aspect of the invention, in the medium according to the tenth or eleventh aspect of the invention, the medium may be a playing card, and any one of a RFID tag, a magnetic storage unit, and a memory composed of an IC chip may be built in the medium. [0028]

The medium surface, such as the card, is divided into regions where two or more of dot patterns indicating two or more of different code values or coordinate values are printed, and the different information can be outputted according to the reading locations of the medium surface. Further, the different code for each pixel can be represented by the dot pattern while managing the entire surface of the medium surface of the card or the like by XY coordinates.

[0029]

In the medium, a RFID tag, a magnetic storage unit, or a memory unit composed of an IC chip or the like are built. A rotation angle of the card, a trace where the card moves, coordinates, target items, score, remaining points after the game (for example, the game can be performed until 500 points,

and remaining points in a case in which the points is reduced whenever the card game is performed) can be recorded on each medium (card) or reflected to the game.

[0030]

According to a thirteenth aspect of the invention, there is provided an information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by imaging units disposed in a space below the stage, code values indicating the dot patterns and directions of the media obtained from the analyzed result of the dot patterns are calculated from photographed images obtained by the imaging units and locations of the media disposed on the stage surface defined by XY coordinates are calculated, and information corresponding to the calculation results is outputted.

[0031]

According to a fourteenth aspect of the invention, in the information output device according to the thirteenth aspect of the invention, the imaging unit may detect brightness of a checking pixel group set at a predetermined interval among pixel matrices of the predetermined number, determines that the medium is disposed on the pixel matrix, when the brightness is equal to or greater than a predetermined threshold value,

and code analysis of dot patterns is performed with respect to only a pixel matrix group that has been determined that the medium is disposed.

[0032]

As such, with respect to not all pixels but a pixel group for check, it is determined by the brightness whether the medium exists or not, and thus it is efficiently determined whether the card exists or not. Further, with respect to only the pixel matrix group on which the medium is disposed, the code analysis λ of the dot pattern is performed, and the analysis of the dot pattern can be efficiently performed.

[0033]

According to a fifteenth aspect of the invention, there is provided an information output device in which media are disposed on a stage surface in a state where the media are opposite to the stage surface, the media where dot patterns are printed on medium surfaces on the basis of a predetermined rule, the dot patterns are read by an imaging unit disposed in a space below the stage, code values indicating the dot patterns and directions of the media obtained from the analyzed result of the dot patterns are calculated from photographed images obtained by the imaging unit and locations of the media disposed on the stage surface defined by XY coordinates are calculated, and information corresponding to the calculated results is outputted. Further, in the space below the stage,

a projection unit is disposed, in addition to the imaging unit, and the projection unit controls images or moving pictures projected on the stage surface by calculating the code values of the dot patterns obtained from the photographed images by the imaging unit and the direction of the card obtained from the analyzed results of the dot patterns and calculating the location of the medium disposed on the stage surface defined by XY coordinates.

[0034]

According to a sixteenth aspect of the invention, in the information output device according to the fifteenth aspect of the invention, an upper layer of the stage may be composed of a transparent plate, and a lower layer of the stage may be composed of a projection sheet for a projection unit.

[0035]

According to a seventeenth aspect of the invention, in the information output device according to the seventh or sixteenth aspect of the invention, in the space below the stage, at locations that avoid projected light from the projection unit to the stage surface, light irradiation light sources that irradiate irradiated light onto the dot patterns of the medium surface on the stage surface, and a dispersion filter that disperses the irradiated light of the light irradiation light source into the bottom surface of the stage may be provided.

[0036]

According to an eighteenth aspect of the invention, in the information output device according to the fifteenth aspect of the invention, a magic mirror may be obliquely provided in the space below the stage, a projection unit may be disposed at one surface side of the magic mirror, projection images or moving pictures from the projection unit may be reflected on the one surface to be projected onto the stage surface, and an imaging unit may be disposed on the other surface side of the magic mirror, and photographed light of the dot patterns of the medium surface on the stage surface transmits the magic mirror to be incident on the imaging unit.

[0037]

According to a nineteenth aspect of the invention, in the information output device according to the fifteenth aspect of the invention, mirrors may be obliquely provided in the space below the stage, a projection unit and an imaging unit may be disposed on one surface side of the mirror, and projection images or moving pictures from the projection unit may be reflected on the one surface to be projected onto the bottom surface of the stage.

[0038]

As such, in addition to the imaging units, a projection unit in which the images or the moving pictures projected onto the stage surface are controlled by the code values or the coordinate values of the dot patterns obtained from the

photographing images by the imaging unit are provided in the space below the stage surface. The images or the moving pictures projected onto the stage surface where the medium is disposed can be controlled by the dot patterns of the medium surface. When the game is performed by using the medium such as the card, the game production or the score can be displayed by the images or the moving pictures of the stage surface where the cards are disposed. [0039]

Accordingly, the medium, such as, the card or the like, on which the dot pattern is printed may be used as a controller of moving picture or image display. [0040]

As for the mirror, if the metal material is deposited on the metal mirror, since it intercepts the infrared rays, it is preferable that the deposition material for transmitting the infrared ray (non-carbon black) be deposited. [0041]

Further, the number of mirrors is not limited to one, and a plurality of mirrors may obliquely provided (with multistage) . [0042]

As such, if the mirrors are provided with a multistage structure, a projection unit and an imaging unit are disposed on the side of one surface of a mirror of a final stage.

[ 0043 ]

Further, the projection unit (projector) may make projected light reflected on all mirrors having a multistage structure, such that projection images or moving pictures may be displayed on a bottom surface of the stage. Meanwhile, the imaging unit may make the imaging light from the bottom surface of the stage reflected on only a mirror of a middle stage, such that the bottom surface of the stage may be photographed. [0044]

As such, the reason why the stage number of the imaging unit is smaller than that of the projection unit is as follows. Since the imaging unit preferably set the focal distance to be shorter than that of the projection unit, the stage number of the mirrors becomes smaller, and thus photographing can be performed with high precision (refer to Fig. 38C) . [0045]

According to a twentieth aspect of the invention, there is provided an information output device in which an illumination unit irradiates irradiation light onto a medium where dot patterns to be reactive with predetermined irradiation light are printed, reflected light is read by an imaging unit, photographed images obtained by the imaging unit are converted into code values or coordinate values indicating the dot patterns, and information corresponding to the code values or the coordinate values is outputted. Further, the

imaging unit selectively or overlappingly reads one system or a plurality of systems of dot patterns among two systems or more of dot patterns formed by at least two kinds of inks having different reactivity printed on the medium so as to be converted into code values or coordinate values.

[0046]

According to a twenty first aspect of the invention, there is provided an information output device in which an illumination unit irradiates irradiation light onto a medium where dot patterns to be reactive with predetermined irradiation light are printed, reflected light is read by an imaging unit, code values indicating dot patterns and the direction of the medium obtained from the analyzed result of the dot patterns from the photographed images obtained by the imaging unit are calculated and the location of the medium disposed on the stage surface defined by XY coordinates is calculated, and information according to the calculated result is outputted. Further, the imaging unit selectively or overlappingly reads one system or a plurality of systems of dot patterns among two systems or more of dot patterns formed by at least two kinds of inks having different reactivity printed on the medium so as to be converted into code values or coordinate values.

[0047] According to a twenty second aspect of the invention,

in the information output device according to the twentieth and twenty first aspects of the invention, the irradiation light may be an infrared ray, and the at least two kinds of inks having different reactivity may be two kinds of inks that have different infrared ray absorptivity with respect to all frequency bands, respectively.

[0048]

According to a twenty third aspect of the invention, in the information output device according to the twentieth and twenty first aspects of the invention, the irradiation light may be an infrared ray, and the at least two kinds of inks having the different reactivity may be two kinds of inks that have different peak value wavelength characteristic of infrared ray absorptivity, respectively.

[0049]

According to a twenty fourth aspect of the invention, in the information output device according to the twentieth and twenty first aspects of the invention, the irradiation light may be an infrared ray, and the at least two kinds of inks having the different reactivity may be two kinds of inks, each of which has a different peak value wavelength characteristic of infrared ray absorptivity, and the irradiation unit may have two or more of irradiation sections, each of which adjusts an infrared wavelength for each different peak value of infrared ray absorptivity.

[ 0050 ]

According to a twenty fifth aspect of the invention, in the information output device according to the twentieth or twenty first aspect of the invention, the irradiation light may be an infrared ray, and the at least two kinds of inks having different reactivity may be respectively a first ink and a second ink, the first ink having a small peak value of infrared ray absorptivity and a small wavelength, the second ink having a large peak value of infrared ray absorptivity and a large wavelength, the irradiation unit may have a first irradiation unit and a second irradiation unit, the first irradiation unit having wavelength characteristic of almost an entire region of an infrared wavelength, the second irradiation unit being suitable for a wavelength in which the infrared absorptivity of the first ink is larger than the infrared absorptivity of the second ink, and the first and second irradiation units may selectively or overlappingly irradiate irradiation light onto the medium, and the reading unit may selectively or overlappingly reads a first dot pattern printed by the first ink or a second dot pattern printed by the second ink.

[0051]

As such, the two system or more of dot patterns that are formed of at least two kinds of inks are formed on the medium surface, and the imaging unit of the information output device selectively or overlappingly reads the dot patterns of one

system or the plurality of systems and converts them into the code values or the coordinate values . Thereby, the two systems or more of dot patterns can be formed, and the information amount of the medium surface can be increased. Further, the selectivity is raised, and thus security can be improved. [0052]

An infrared ray is used as the irradiated light, and two kinds or more of inks, each of which has different infrared ray absorptivity, or two kinds or more of inks, each of which has different wavelength characteristic of the peak value of the infrared ray absorptivity are used as the two kinds or more of inks. As a result, the dots are selectively analyzed by the difference between the reactivity when the infrared ray is irradiated, and thus the selectivity of the infrared ray can be improved at the time of reading. In the case in which the medium surface is copied by the copying machine, the security can be improved. [0053]

The at least two kinds of inks, each of which has different reactivity, correspond to a first ink in which a peak value of the infrared ray absorptivity is small and the wavelength is short, and a second ink in which a peak value of the infrared ray absorptivity is large and the wavelength is long. The irradiation unit has a first illumination unit that has wavelength characteristic of a substantially entire

region of the infrared ray wavelength, and a second illumination unit that is suitable for the wavelength in which the infrared ray absorptivity of the first ink is higher than the infrared ray absorptivity of the second ink. The first and second irradiation units selectively or overlappingly the irradiation light onto the medium, and thus the reading unit can selectively or overlappingly read the dot patterns printed by the first ink or the dot patterns printed by the second ink. Therefore, the information amount can be increased, and the security can be improved.

[0054]

According to a twenty sixth aspect of the invention, there is provided a medium in which predetermined irradiation light is irradiated onto at least a medium surface by an imaging unit, dot patterns printed on the medium surface are optically photographed by reading reflective light by the imaging unit and converted into code values or coordinate values indicating the dot patterns from the photographed images, and information corresponding to the code values or the coordinate values is outputted to the information output device. Further, two systems of dot patterns that are formed by at least two kinds of inks having different reactivity with respect to the predetermined irradiated light are printed on the medium surface.

[0055]

According to a twenty seventh aspect of the invention, there is provided a medium in which predetermined irradiation light is irradiated onto at least a medium surface by an imaging unit, dot patterns printed on the medium surface are optically photographed by reading reflective light by the imaging unit, code values indicating the dot patterns and directions of the cards obtained from the recognition result of the dot patterns are calculated from the photographed images and the location of the card disposed on the stage surface defined by XY coordinates is calculated, and information according to the calculated results is outputted to an information output device. Further, two systems of dot patterns that are formed by at least two kinds of inks having different reactivity with respect to the predetermined irradiated light are printed on the medium surface.

[0056]

According to a twenty eighth aspect of the invention, in the medium according to the twenty sixth and twenty seventh aspect of the invention, the irradiation light may be an infrared ray, and the at least two kinds of inks having the different reactivity may be two kinds of inks that have different infrared ray absorptivity, respectively.

[0057]

According to a twenty ninth aspect of the invention, in the medium according to the twenty sixth and twenty seventh

aspect of the invention, the irradiation light may be an infrared ray, and the at least two kinds of inks having the different reactivity may be two kinds of inks that have infrared wavelengths, respectively.

[0058]

According to a thirtieth aspect of the invention, in the medium according to any one of the twenty sixth, twenty seventh, twenty eighth, and twenty ninth, the medium may be a playing card.

[0059]

According to a thirty first aspect of the invention, in the medium according to the thirtieth aspect of the invention, any one of a RFID tag, a magnetic storage unit, or a memory composed of an IC chip may be built in the playing card.

[0060]

According to a thirty second aspect of the invention, in the medium in the medium according to any one of the twenty sixth, twenty seventh, twenty eighth, and twenty ninth aspects of the invention, the medium is a counterfeit preventing subject medium, such as a seal, a tag, a certificate (an identification certificate and a passport) , an exchange ticket for money, and a ticket.

[0061]

According to the thirty third aspect of the invention, in the medium according to the thirty second aspect of the

invention, an RFID tag may be built in the counterfeit preventing subject medium.

[0062]

As such, the two systems or more of dot patterns that are formed of at least two kinds of inks are formed on the medium surface, and the imaging unit of the information processing device selectively or overlappingly reads the dot patterns of one system or the plurality of systems and converts them into the code values or the coordinate values. Thereby, the two systems or more of dot patterns can be formed,, and the information amount of the medium surface can be increased. Further, the selectivity is raised, and thus security can be improved.

[0063]

The infrared ray is used as the irradiation light, and two kinds or more of inks, each of which has different infrared ray absorptivity, or two kinds or more of inks, each of which has different wavelength characteristic of the peak value of the infrared ray absorptivity are used as the two kinds or more of inks. As a result, the dots are selectively analyzes by the difference between the reactivity when the infrared ray is irradiated, and thus the selectivity can be improved at the time of reading. In the case in which the medium surface is copied by the copying machine, the security can be improved.

[0064]

The at least two kinds of inks, each of which has different reactivity, correspond to a first ink in which a peak value of the infrared ray absorptivity is small and the wavelength is short, and a second ink in which a peak value of the infrared ray absorptivity is large and the wavelength is long. The irradiation unit has a first illumination unit that has wavelength characteristic of a substantially entire region of the infrared ray wavelength, and a second illumination unit that is suitable for the wavelength in which the infrared ray absorptivity of the first ink is higher than the infrared ray absorptivity of the second ink. The first and second irradiation units selectively or overlappingly the irradiation light onto the medium, and thus the reading unit can selectively or overlappingly read the dot patterns printed by the first ink or the dot patterns printed by the second ink. Therefore, the information amount can be increased, and the security can be improved. [0065]

The medium is used as a seal, a tag, a certificate (an identification certificate, and a passport) , an exchange ticket for money, a ticket, and the like. As a result, the selectivity of the dot pattern or the infrared ray characteristic can be improved. The security for fabrication preventing can be raised. [0066]

According to a thirty fourth aspect of the invention, there is provided an information input/output device in which medium surfaces of a plurality of media where code information indicating characters or numerical values, such as the characters, pictures, two-dimensional codes, and the like, or numerical values are printed by ink having infrared ray absorbing characteristic are disposed on a stage surface transmitting infrared rays in a state in which the media surfaces are opposite to the stage surface, infrared rays are irradiated onto a bottom surface of the stage by an infrared ray irradiating unit provided at an inner circumference of the space below the stage surface, reflected light is photographed by an infrared ray imaging unit, and an information processing unit for outputting multimedia information, such as sounds, characters, images, moving pictures, and the like, on the basis of photographed images obtained from the infrared ray imaging unit, is provided. Further, on the basis of projection images from the infrared ray imaging unit, the information processing unit inputs positional information of a medium on the stage surface, direction information or medium state information indicating a contact state between the stage surface and the medium, and code information printed on the medium surface, and the information processing unit outputs and displays the medium state information and multimedia information, such as characters, images, moving pictures, and the like,

corresponding to the code information, to and on an entire surface or a portion of the stage surface composed of a projection panel with respect to the projection unit disposed below the stage surface . [0067]

As such, the code information printed on the medium is photographed by the infrared ray imaging unit that is provided below the bottom surface of the stage, and the characters, images or moving pictures associated with the photographed images are displayed on the surface of the stage on which the medium is disposed. As a result, the production of the stage surface interlocked with the code information of the medium can be made.

[0068]

According to the thirty fifth aspect of the invention, in the information output device according to the thirty fourth aspect of the invention, the multimedia information may be information that indicates medium arrangement on the projection panel surface and an operation instruction.

[0069]

As such, the arrangement of the medium or the operation instruction is performed by the multimedia information displayed on the surface of the stage, and the medium can be easily operated. In addition, the stage effect of the game can be further raised.

[0070]

According to a thirty sixth aspect of the invention, in the information output device according to thirty fourth aspect of the invention, the code may be a dot pattern-.

[0071]

As such, the dot patterns are used, and the image process and the code analysis can be performed at high speed. Further, the direction of the medium surface can be easily calculated, and a variety of code information can be recorded on the medium.

[0072]

According to a thirty seventh aspect of the invention, in the information input and output device according to the thirty fourth aspect of the invention, pictures or characters may be printed on a portion and all of a top surface of the projection panel by using an infrared ink or an infrared ray transmitting sheet printed by the infrared ray transmitting ink may be attached to the portion and all of the top surface of the projection panel.

[0073]

As such, the pictures or the characters are previously printed on the top surface of the projection panel by using the infrared ray transmitting ink, and thus it is possible to raise the stage effect combined with the multimedia information projected from the lower side.

[0074]

The infrared ray transmitting sheet is attached, and the surface of the projection panel can be protected from being damaged. In addition, even if the infrared ray transmitting sheet is damaged, it can be easily exchanged with a new one.

[0075]

According to a thirty eighth aspect of the invention, in the information input and output device according to any one of the thirty fourth to thirty seventh aspects of the invention, a frame designating a projection region for projecting light by the projection unit or marks designating four corners of the projection region may be printed on the top surface of the projection panel or the infrared ray transmitting sheet according to claim 37 by using visible infrared ray transmitting ink, or a removable infrared ray transmitting sheet printed by the ink is attached, and the information processing-unit may allow the projection unit to project a frame indicating a projection region or marks indicating four corners of the projection region onto the projection panel, and may correct a visibly designated projection region and a projection region of the projection image to be equal to each other. [0076]

As such, the ' marks indicating four corners of the projection region are projected onto the projection panel from the projection unit, and thus the deviation of the projection

unit with respect to the projection panel can be corrected (calibration) . When the projection region instruction frame or mark is not printed on the projection panel or the infrared ray transmitting sheet, they are- printed on the removable infrared ray transmitting sheet, and after the correction, the infrared ray transmitting sheet can be removed.

[0077]

According to a thirty ninth aspect of the invention, in the information input and output device according to any one of the thirty fourth to thirty eighth aspect of the invention, dot marks designating four corners of a region photographing an infrared image may be printed by using an infrared ray absorbing ink on the top surface of the projection panel, or a removable infrared ray transmitting sheet printed by the ink may be attached. The information processing unit may recognize coordinates of the four corners on the basis of the dot marks photographed by the infrared ray imaging unit, may determine whether the coordinates are at the same locations as information of four corners of the photographic regions previously stored in a storage unit, and may display the result information and instruction information on the projection panel by the projection unit.

[0078]

As such, the dot marks instructing the four corners of the region for photographing the infrared image are previously

printed in the projection panel or the infrared ray transmitting sheet, and the deviation of the imaging unit with respect to the projection panel is displayed on the projection panel by the projection unit, and the correction (calibration) can be made. If the large capacity of storage unit is provided, it is possible to automatically correct the photographic region of the storage unit. Further, when the infrared ray absorbing dot marks are not printed on the projection panel or the infrared ray transmitting sheet, they are printed on the removable infrared ray transmitting sheet, and after the correction, the removable infrared ray transmitting sheet can be removed.

[0079]

According to a fortieth aspect of the invention, in the information input and output device according to the thirty fourth aspect of the invention, the information processing unit may output to the projection unit information indicating characters, diagrams, images or moving pictures that are associated with the medium disposed on the surface of the projection panel.

[0080]

Specifically, when the medium is a card for a game, the moving picture indicating fire or water according to the attribute of the card may be projected onto the peripheral portions of the card. Further, when the medium is a figure

(doll) that has a bottom surface on which the code information is printed, the region of the dialogue balloon is displayed around the figure, and the word of the figure may be displayed by the characters.

[0081]

According to a forty first aspect of the invention, in the information input and output device according to the fortieth aspect of the invention, the information processing unit may output to the projection unit information indicating characters, diagrams, images or moving pictures associated with the medium to locations the projection panel surface that do not overlap a contact surface of the medium.

[0082]

Specifically, when the plurality of cards are disposed on the surface of the projection panel, the multimedia information indicating characters, diagrams, images, moving pictures, and the like can be displayed at locations shifted from the disposed cards. Further, the production can be made by the images, the moving pictures, and the like from the interface of the contact surface of the medium. For example, in the case of the figure, the shadow is projected, and the in the case of the card, the characters, the diagrams, the images, and the moving pictures that are continuous to the images plotted on the card are displayed.

[0083]

According to a forty second aspect of the invention, in the information input and output device according to any one of the thirty fourth to forty first aspects of the invention, medium information indicating .a kind and a shape of the medium or a shape of the medium surface may be defined in the code information printed on the printing surface, and information indicating characters, diagrams, images or moving pictures projected onto the projection panel surface may be created on the basis of the medium information.

[0084]

In the code information, medium information indicating the kind or the shape of the medium is contained, and when the code information is photographed by the imaging unit, since the information processing device discriminates the kind or the shape of the medium, the multimedia information corresponding to the kind or the shape of the medium can be outputted.

[0085]

For example, when the information indicating the kind of the medium, such as the figure or the card, is used, in the case of the figure, a word made of characters, and in the case of the medium, the score can be displayed on the projection panel .

[0086]

In case of the figure (doll) with a, height that the code

information is printed on the bottom surface, when an obliquely upward side of the player stage is visible, the multimedia information indicating characters, diagrams, images, moving pictures, and the like can be displayed at locations that do not become the shadow of the figure at the time of being viewed from an eye line. [0087]

When the shape of the medium or the shape of the medium surface is stored as the medium information, an algorithm may be omitted in which the imaging unit directly recognizes the shape of the medium from the proj ection image . The information that indicates the characters, images, moving pictures, and the like having considered the shapes may be displayed on the panel surface.

[0088]

According to a forty third aspect of the invention, in the information output device according to the thirty fourth aspect of the invention, the information processing unit may detect an operation of the medium that operates by a user on a stage surface on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the projection panel, the information processing unit may recognize a grid tapping operation of the medium on the

projection panel, that is, may read XY coordinate information calculated in substantially the same region as the location where the medium is disposed in a predetermined time or a designated region and/or code information many times to recognize the XY coordinates and the code information. [0089]

According to a forty fourth aspect of the invention, in the information input/output device according to the thirty fourth aspect of the invention, the information processing unit may detect an operation of the medium that operates by a user on a projection panel on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, the information processing unit may perform a grid twist operation that rotates the medium on the basis of any location of the medium surface on the projection panel surface, such that a rotation angle of the medium or traces of the rotation angle with respect to the direction of the imaging unit are repeatedly recognized in a predetermined time.

[0090]

According to a forty fifth aspect of the invention, in the information input/output device according to the thirty fourth aspect of the invention, the information processing

unit may detect an operation of the medium that operates by a user on a stage surface on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating locations of the medium on the stage surface, the information processing unit may perform a circular grid sliding operation of the medium surface on the projection panel surface, such that traces of the XY information calculated in a predetermined time is recognized as a substantially circular shape.

[0091]

According to a forty sixth aspect of the invention, in the information input/output device according to the thirty fourth aspect of the invention, the information processing unit may detect an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, the information processing unit may perform a straight-line-shaped grid scrolling operation of the medium on the projection panel surface, such that traces of the XY coordinate information calculated in a predetermined time is recognized as a substantially straight line shape.

[0092]

According to a forty seventh aspect of the invention, in the information input/output device according to the thirty fourth aspect of the invention, the information processing unit may detect an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, the information processing unit may perform a grid scratching operation of the medium repetitively in a straight line shape on the projection panel surface, such that it is recognized that traces of the XY information calculated in a predetermined time is repeated in a substantially straight line shape.

[0093]

According to a forty eighth aspect of the invention, in the information input/output device according to a thirty fourth aspect of the invention, the information processing unit may detect an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the stage surface, the information

processing unit may perform a grid tilting operation of inclining the medium on the projection panel surface, such that a variation of inclination of the medium with respect to a vertical line of the projection panel in a predetermined time is recognized. [0094]

According to a forty ninth aspect of the invention, in the information input/output device according to the thirty fourth aspect of the invention, the information processing unit may detect an operation of the medium that operates by a user on the projection panel surface on the basis of state information of the medium. After the information processing unit analyzes codes printed on the medium surface to specify the medium, and calculates XY coordinates indicating a location of the medium on the projection panel surface, the information processing unit may perform a grid turnover operation of turning over a portion of the medium surface on the projection panel surface, such that a variation of an area ratio of the medium surface turned over from the projection panel surface in a predetermined time is recognized.

[0095]

As such, the information processing unit detects operations of the medium on the surface of the proj ection panel, that is, a grid tapping operation, a grid twist operation, a grid sliding operation, a grid scrolling operation, a grid

scratching operation, a grid tilting operation, a grid turnover operation, and the like, and it is possible to vary the multimedia information, such as characters, diagrams, images, moving pictures, and the like, that is associated with the above-described operations and displayed on the surface of the projection panel. A variety of stage effects can be achieved.

[0096]

According to a fiftieth aspect of the invention, in the information input/output device according to the forty eighth or forty ninth aspect of the invention, the information processing unit may perform the operation of the medium according to the forty eighth or forty ninth aspect of the invention, such that characters, diagrams, images or moving pictures corresponding to the code information are projected onto a region of the projection panel surface from which the medium surface is turned over, by means of the projection unit.

[0097]

For example, when the medium is a card, such as the trump, the image of the portion turned over from the surface of the projection panel (kinds or numerical values of the card printed at corners of the trump) can be displayed on the region of the projection panel surface where the medium surface is turned over, and thus it is possible to raise the display stage effect on the projection panel surface accompanied with the card

operation by the player. [0098]

According to a fifty first aspect of the invention, in the information input and output device according to the forty eighth or forty ninth aspect of the invention, the inclination according to the forty eighth aspect of the invention or the area ratio according to the forty ninth aspect of the invention may be recognized by brightness of the infrared image obtained by photographing a region where the medium is turned over the stage surface, by means of the imaging unit. [0099]

When the medium surface is tilted from the projection panel surface, or when the portion of the medium is turned over from the projection panel surface, the brightness region of the photographed images or the shape of the brightness and the darkness by the imaging unit are gradually varied. The information processing unit recognizes the state or shape of the bright region in the photograph image. As a result, the inclination of the medium and the inclined direction, a portion of the turned over medium surface, and the size thereof can be recognized. [0100]

Accordingly, if varying the multimedia information indicating characters, the diagrams, the images, the moving pictures, and the like displayed on the surface of the

projection panei in accordance with the recognized result, it is possible to raise the stage effect with respect to the player.

[0101]

According to a fifty second aspect of the invention, in the information input/output device according to the forty eighth aspect of the invention or the forty ninth aspect of the invention, the operation of the medium according to any one of the forty third to forty ninth aspects of the invention may be based on the recognition of the number of times or speed of the operation repeated at a predetermined time.

[0102]

As such, a grid tapping operation, a grid twist operation, a grid sliding operation, a grid scrolling operation, a grid scratching operation, a grid tilting operation, a grid turnover operation, and the like are repeated, and it is possible to vary the multimedia information, such as characters, diagrams, images, moving pictures, and the like, displayed on the surface of the projection panel by the number of times of the repetition of the operation and the operation speed. Therefore, it is possible to raise the stage effect with respect to the player. [0103]

According to a fifty third aspect of the invention, in the information input/output device according to the forty

third to forty ninth aspects of the invention, the operation of the medium according to any one of the forty third to fifty second aspects of the invention may be based on a history stored in a storage unit. [0104]

According to a fifty fourth aspect of the invention, there is provided an information output device in which a medium is disposed on a stage surface in a state where the medium is opposite to the stage surface, the medium where dot patterns are printed on a medium surface on the basis of a predetermined rule, the dot patterns are read by an imaging unit disposed in a space below the stage, code values indicating the dot patterns and directions of the media obtained from the analyzed result of the dot patterns are calculated from photographed images obtained by the imaging unit and locations of the media disposed on the stage surface defined by XY coordinates are calculated, and information corresponding to the calculated results is outputted. Further, the imaging unit detects brightness of each pixel or a pixel group among pixel matrices of the predetermined number, and recognizes a shape of the medium on the basis of a pixel or a pixel group whose brightness is equal to or more than a previously set threshold value.

[0105]

According to a fifty fifth aspect of the invention, in the information output device according to the fifty fourth

aspect of the invention, the recognized medium may be a card. [0106]

According to a fifty sixth aspect of the invention, in the information output device according to the fifty fourth aspect of the invention, the recognized medium may be a fingertip of an operator or a player.

[0107]

According to a fifty seventh aspect of the invention, in the information output device according to any one of fifty fourth to fifty sixth aspects of the invention, the centroid of the medium may be calculated by a medium shape recognizing image from the imaging unit, and an operation corresponding to coordinates of the centroid may be performed.

[0108]

According to the above-described aspects of the invention, the operation history of the grid tapping operation, the grid twist operation, the grid sliding operation, the grid scrolling operation, the grid scratching operation, the grid tilting operation, the grid turnover operation, and the like is stored in the storage unit of the information processing unit, and the multimedia information indicating characters, diagrams, images, moving pictures, and the like displayed on the surface of the proj ection panel is varied by the combination of the operations. As a result, it is possible to raise the stage effect with respect to the player.

Advantage of the Invention

[0109]

According to the invention, it is possible to achieve an information output device in which the information of the medium disposed on the stage surface can be surely or efficiently read, and the stage effect and the security can be raised.

Brief Description of the Drawings

[0110]

Fig. 1 is a perspective view illustrating a card game machine according to a first embodiment of the invention.

Fig.2 is a block diagram illustrating a system structure of a card game machine.

Fig.3 is a block diagram illustrating a system structure of a sensor unit.

Fig.4 is a block diagram illustrating a system structure of a sensor unit.

Fig. 5 is a block diagram illustrating another example of a system structure of a card game machine of the invention.

Fig. 6A is a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a plan view of the card arrangement panel from an upper side, Fig. 6B is

a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a longitudinal cross-sectional view illustrating an enlarged cross-sectional structure of the card arrangement panel, Fig. 6C is a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a plan view of the card arrangement panel from an upper side.

Fig.7 is a diagram illustrating a card arrangement panel whose bottom surface is provided with an IR filter or a color filter.

Fig. 8 is a diagram illustrating a state in which games are actually performed by using a plurality of card game machines .

Fig. 9 is a perspective view illustrating a card gate machine according to a second embodiment of the invention.

Fig. 10 is a longitudinal cross-sectional view illustrating a casing of a card game machine according to a second embodiment of the invention.

Fig. 11 is a plan view illustrating a card game machine according to a second embodiment of the invention when viewed from an upper side.

Fig. 12 is a block diagram illustrating a system structure of a card game machine.

Fig. 13 is a block diagram illustrating a system structure of a card game machine.

Fig. 14A is a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a plan view of the card arrangement panel from an upper side, and Fig. 14B is a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a plan view of the card arrangement panel from an upper side.

Fig. 15A is a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a plan view of the card arrangement panel from an upper side, and Fig. 15B is a diagram illustrating a card arrangement panel in which printing is performed on an entire top surface of the card arrangement panel, which illustrates a plan view of the card arrangement panel from an upper side.

Fig. 16 is a diagram illustrating an example of a dot pattern.

Fig. 17 is an enlarged view illustrating an example of an information dot of a dot pattern.

Fig. 18 is a diagram illustrating arrangement of an information dot.

Fig. 19 is a diagram illustrating an example of an

information dot and bit display of data defined therefrom.

Fig. 2OA is a diagram illustrating an example of an information dot and bit display of data defined therefrom, which illustrates a case in which two dots are arranged, Fig. 2OB is a diagram illustrating an example of an information dot and bit display of data defined therefrom, which illustrates a case in which four dots are arranged, Fig. 2OC is a diagram illustrating an example of an information dot and bit display of data defined therefrom, which illustrates a case in which five dots are arranged.

Fig. 21A is a diagram illustrating a modification of a dot pattern, which illustrates a case in which six information bits are arranged, Fig. 21B is a diagram illustrating a modification of a dot pattern, which illustrates a case in which nine information bits are arranged, Fig. 21C is a diagram illustrating a modification of a dot pattern, which illustrates a case in which twelve information bits are arranged, Fig. 21D is a diagram illustrating a modification of a dot pattern, which illustrates a case in which thirty sixth information bits are arranged.

Fig. 22 is a diagram illustrating a case in which a specification of information dot arrangement is changed to define a block direction, in dot patterns shown in Figs. 16 to 21.

Fig. 23 is a diagram illustrating a case in which a

specification of information dot arrangement is changed to define a block direction, in dot patterns shown in Figs. 16 to 21, which illustrates arrangement of information bit.

Fig. 24A is a diagram illustrating a card used in a card game machine, which illustrates a back surface of a card, and Fig. 24B is a diagram illustrating a card used in a card game machine, which illustrates a case in which a location and a direction of the card are changed by card movement.

Fig. 25A is a diagram illustrating a card used in a card game machine, which illustrates a back surface of a card, and Fig. 25B is a diagram illustrating a card used in a card game machine, which illustrates a case in which a location and a direction of the card are changed by card movement.

Fig.26 is a diagram illustrating a method of calculating an angle of a card in Figs. 24 and 25.

Fig. 27 is a diagram illustrating a card used in a card game machine.

Fig. 28 is a plan view illustrating a state in which a card is disposed on a card arrangement panel, when viewed from an upper side.

Fig. 29 is a diagram illustrating an image that is obtained by photographing a card disposed on a card arrangement panel by using a sensor unit.

Fig.30 is a diagram illustrating a method of determining where a card exists or not.

Fig. 31 is a diagram illustrating a method of analyzing a code of a card.

Fig. 32 is a diagram illustrating a method of recognizing a location and an angle of a card.

Fig.33 is a diagram illustrating a method of calculating a moved angle and a moved amount, when a player moves a card.

Fig. 34A is a diagram illustrating a case in which a trace of a card is used as a parameter, which illustrates a case in which a card is moved in a cylindrical shape, and Fig. 34B is a diagram illustrating a case in which a trace of a card is used as a parameter, which illustrates a case in which a card is moved in a rectangular shape.

Fig. 35 is a diagram illustrating a state in which a game is actually performed by using a plurality of card game machines .

Fig. 36 is a perspective view illustrating a card game machine in which only one sensor is provided and an image is displayed on a card arrangement panel.

Fig. 37 is a longitudinal cross-sectional view illustrating a card game machine according to an embodiment of the invention which is shown in Fig. 36.

Fig. 38 is a longitudinal cross-sectional view illustrating a card game machine according to another embodiment of the invention which is shown in Fig. 36.

Fig. 39 is a diagram illustrating a display example of

an image displayed on a card arrangement panel, and an operation of a player.-

Figs. 4OA and 4OB are diagrams illustrating a card game machine in which a monitor is disposed to be inclined at the side of a player, Fig. 4OA is a plan view illustrating a card game machine, and Fig. 40B is a longitudinal cross-sectional view illustrating a card game machine.

Fig. 41 is a perspective view illustrating a card game machine according to another embodiment of the invention in which a sensor moves onto a rail.

Fig. 42 is a perspective view illustrating a card game machine according to another embodiment of the invention in which an infrared scanner is used.

Fig. 43 is a diagram illustrating a card game machine according to another embodiment of the invention which is connected to a television monitor and in which a game is performed by arranging a card on a table.

Fig. 44 is a diagram illustrating a card game machine according to another embodiment of the invention which is connected to a television monitor and in which a game is performed in a state in which a card is inserted into a card inserting slot.

Fig. 45 is a diagram illustrating a card game machine according to another embodiment of the invention which is connected to a television monitor and in which a game is

performed in a state in which a card passes through a slit.

Fig.. 46 is a diagram illustrating a card game machine according to another embodiment of the invention which is connected to a television monitor and in which a game is performed in a state in which a card is inserted into a card inserting slot.

Fig. 47 is a first diagram illustrating a card game machine according to another embodiment of the invention in which a dot pattern is disposed on both sides of a card.

Fig. 48 is a second diagram illustrating a card game machine according to another embodiment of the invention in which a dot pattern is disposed on both sides of a card.

Fig. 49 is a diagram illustrating a structure in which dot patterns of a plurality of sheets of cards are simultaneously read in a card game machine.

Fig. 50 is a diagram illustrating dot patterns of a plurality of sheets of cards.

Fig. 51 is a diagram illustrating a printing state of dot patterns of a card on the assumption of performing reading by overlapping.

Fig. 52 is a diagram illustrating a transparent card case on the assumption of performing reading by overlapping.

Fig. 53 is a perspective view and a cross-sectional view illustrating a stage in a case in which a medium is set to a figure .

Fig. 54 is a graph illustrating the difference between infrared ray absorptivity of two kinds of inks.

Fig. 55 is a diagram illustrating a recognition state of a dot pattern that uses characteristic ink used in Fig. 54.

Fig. 56 is a graph illustrating three kinds of inks whose peak wavelength characteristics are different from one another.

Fig. 57 is a first diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 56.

Fig. 58 is a second diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 56.

Fig. 59 is a graph illustrating characteristics of two kinds of inks whose infrared absorbing rates and peak wavelengths are different from each other.

Fig. 60 is a first diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 59.

Fig. 61 is a second diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 59.

Fig. 62 is a graph illustrating characteristics of two kinds of inks whose infrared absorbing rates and peak wavelengths are different from each other.

Fig. 63 is a first diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 62.

Fig. 64 is a second diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 62.

Fig. 65 is a diagram illustrating characteristic of two kinds of inks whose peak wavelength characteristics are different from each other, and characteristic of an infrared ray transmitting rate of a filter.

Fig. 66 is a first diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 65.

Fig. 67 is a second diagram illustrating a recognition state of a dot pattern that uses characteristic ink shown in Fig. 65.

Fig. 68 is a diagram illustrating a case in which a security is raised by selectively reading dots by inks having different infrared absorbing rates.

Fig. 69 is a diagram illustrating a case in which an RFID is built in a card where a dot pattern is formed.

Fig. 70 is a diagram illustrating a case in which a magnetic recording portion is provided on a card where a dot pattern is formed.

Fig. 71 is a diagram illustrating a case in which an IC

chip is built in a card where a dot pattern is formed.

Fig. 72 is a diagram illustrating a Wack-A-Mole game machine that uses a dot pattern.

Fig. 73 is a cross-sectional view illustrating a plane of a stage of a Wack-A-Mole game machine shown in Fig. 72.

Fig .74 is a diagram illustrating a card as one of a medium used in the invention in which code information is printed on a portion facing a projection panel by using infrared ray absorbing ink.

Fig. 75 is a perspective view illustrating a card game machine according to an embodiment of the invention.

Fig. 76 is a perspective view illustrating a portion of a card game machine according to an embodiment of the invention in which a front surface of a stage is used as a projection region of a projection panel and an infrared ray photographic region.

Fig. 77 is a perspective view illustrating a portion of a card game machine according to an embodiment of the invention in which a portion of a stage is used as a projection region of a projection panel and an infrared ray photographic region.

Fig. 78 is a diagram illustrating a card disposed on an entire surface of a projection panel and multimedia information projected onto an entire surface of the projection panel .

Fig. 79 is a diagram illustrating a disposed card in a

state in which a projection panel is divided into a lower half serving as an infrared ray photographic region and an upper half serving as a projection region, and projected multimedia information.

Fig. 80 is a diagram illustrating a card disposed on a projection region where a region for displaying multimedia information is determined and divided by arbitrarily performing non-projection/infrared ray transmitting printing, and multimedia information associated with the card.

Fig. 81 is a diagram illustrating a sectional structure of a projection region, a semi-projection region, and a non-projection region in a projection panel.

Fig. 82 is a diagram illustrating a structure of a projection panel where a projection region designating frame and an photographing location correction dot mark are printed so as to correct a deviation of a projection panel with respect to a projector and an infrared camera.

Fig. 83 is a diagram illustrating a frame and a mark that are projected for printing and correcting a mark and a frame for designating a projection region projected by a projector.

Fig. 84 is a diagram illustrating printing (or projection) of a dot mark for designating an photographic region photographed by an infrared camera, and a dot mark projected for correction and a correction instruction.

Fig. 85 is a diagram illustrating a state in which a score

or a parameter varied by operating a card or a figure disposed on a projection panel is displayed on a projection panel while avoiding a location of a card or a figure.

Fig. 86 is a diagram illustrating a state -in which a shadow or word from a card or a figure disposed on a projection panel is displayed.

Fig. 87 is a subseguently disposed location or an operation instruction is displayed from a card or a figure disposed on an operation panel.

Fig. 88 is a diagram illustrating a grid tapping operation that operates a card or a figure disposed on a projection panel.

Fig. 89 is a diagram illustrating a grid twisting operation that operates a card or a figure disposed on a projection panel.

Fig. 90 is a diagram illustrating a grid sliding operation that operates a card or a figure disposed on a projection panel.

Fig. 91 is a diagram illustrating a grid scrolling operation that operates a card or a figure disposed on a projection panel.

Fig. 92 is a diagram illustrating a grid scratching operation that operates a card or a figure disposed on a projection panel.

Fig. 93 is a diagram illustrating a grid tilt operation

that operates a card or a figure disposed on a projection panel, and brightness of an infrared image obtained by photographing a grid tilt operation state and an image projected onto a region of a surface of a projection panel whose medium surface is reversed.

Fig. 94 is a diagram illustrating a grid turnover operation that operates a card or a figure disposed on a projection panel, and brightness of an infrared image obtained by photographing a grid turnover operation state and an image projected onto a region of a surface of a proj ection panel whose medium surface is reversed.

Fig. 95 is a diagram illustrating a format and a code thereof in a case in which medium kinds, quality of a material of a medium, a medium, a shape of a medium surface, and other information are included.

Fig. 96 is a diagram illustrating an example of a medium that is defined by a dot code of Fig. 95.

Fig. 97 is a diagram illustrating a method of recognizing a shape of a medium disposed on a stage surface.

Fig. 98 is a diagram illustrating a method of recognizing a shape of a medium disposed on a stage surface.

Best Mode for Carrying Out the Invention [0111] <First Embodiment: Multisensor Game Machine>

Figs .1 to 8 are diagrams illustrating a card game machine according to a first embodiment of the invention.

[0112]

Fig. 1 is a front view illustrating an outer appearance of a card game machine in which a plurality of sensors are disposed.

[0113]

The card game machine includes a card arrangement panel on which cards held by a player are arranged. The card arrangement panel has sixteen reading holes that are provided for making a sensor of a sensor unit (which will be described in detail below) irradiating light. Further, the card arrangement panel further has a display on which a progress situation of a game is displayed, and a speaker that outputs music or sounds.

[0114]

Further, in the card game machine, sixteen sensor units are provided. The sensor units are connected to a dot code output controlling unit through a LAN or HuB unit, which will be described below. Furthermore, the dot code output controlling unit is connected to a game microprocessor unit, and the game microprocessor unit is connected to the display and the speaker.

[0115]

Fig. 2 is a block diagram illustrating an example of an

inner structure of the card game machine, which illustrates a state in which essential elements of the card game machine are connected to one another through the HuB unit.

[0116]

As described above, in the card game machine, the sixteen sensor units are provided. These sixteen sensor units are connected to one another through a cable. The cable is connected to the dot code output controlling unit through the HuB unit. Further, the dot code output controlling unit is connected to the game microprocessor unit, and the game microprocessor unit is connected to the display and the speaker.

[0117]

Figs.3 and 4 are block diagrams illustrating a structure of the sensor unit.

[0118]

Fig. 3 is a diagram illustrating a case in which the sensor and a microprocessor unit (MPU) are provided in the sensor unit.

[0119]

A lens is provided on the sensor, and an IR filter is mounted on the top surface of the lens. Further, LEDs are respectively provided at left and right sides of the sensor. The microprocessor unit (MPU) and a frame buffer are provided below the sensor. An image obtained by the sensor is processed

by the microprocessor unit (MPU) attached to the sensor. The IR filter has optical characteristic that transmits only an infrared wavelength (of 700 nm or more) .

[0120]

Fig. 4 is a diagram illustrating a case in which only the sensor is provided in the sensor unit.

[0121]

The lens is provided on the sensor, and the IR filter is mounted on the top surface of the lens. Further, LEDs are respectively provided at left and right sides of the sensor. The image obtained by the sensor is processed by the microprocessor unit (MPU) .

[0122]

Fig. 5 is a block diagram illustrating another example of an inner structure of the card game machine, which illustrates a state in which essential elements of the card game machine are connected to one another through the LAN. Each of sixteen sensor units is connected to the dot code output controlling unit through a LAN cable. Further, the dot code output controlling unit is connected to the game microprocessor unit, which is connected to the display and the speaker.

[0123]

Figs. 6 and 7 are diagrams illustrating a card arrangement panel that is provided on the card game machine.

As structures of the card arrangement panel, examples shown in Figs. 6A to 7C are considered.

[0124]

Figs. 6A and 6C are diagrams illustrating the card arrangement panel when viewed from an upper side, and Fig. 6B is a longitudinal cross-sectional view illustrating an enlarged sectional structure of the card arrangement panel in Fig- 6A.

[0125]

The sensor units (infrared ray irradiating unit) in the card game machine emit infrared light, and form card reading portions at a plurality of predetermined portions of the card arrangement panel (stage surface) , when viewed from the top surface, as shown in Fig. 6A. The cards serving as media are disposed on the card reading portions in a state in which the surfaces of the cards where the dot patterns are formed face the card arrangement panel (stage surface) , and then a game is performed.

[0126]

As shown in Fig. 6B, the card arrangement panel forms a laminated structure in which a plurality of inks are applied onto the top surface of a transparent glass plate. A white ink is applied to the top surface of the glass plate. Further, CMYK inks that do not contain carbon are applied on the white ink.

[ 0127 ]

By applying the white ink to the top surface of the glass plate, it can be prevented that the surface of the card arrangement panel becomes black, and thus it is difficult for contents printed by non-carbon inks to be viewed.

[0128]

Fig. 6C is a diagram illustrating a case in which inks used in printing are different at the card reading portions and the peripheral portions of the card reading portions, and the other portions. That is, in the card reading portions and the peripheral portions thereof, printing is performed by- using only CMY inks that do not contain carbon. In the portions other than the peripheral portions of the card reading portions, printing is performed by using the CMY inks that do not contain carbon and a K ink that contains carbon.

[0129]

In this case, among general inks widely used in printing, the CMY inks are non-carbon inks that do not contain a carbon component, and the K ink is a carbon ink that contains a carbon component. The carbon has characteristic that absorbs infrared rays. Therefore, in a case in which inks containing carbon are used in printing of portions other than the dot patterns, when the infrared rays are irradiated onto the printing surface, the discrimination with the dot patterns may be difficult. In order to avoid this problem, it is preferable

that the K ink also do not contain carbon. However, since the K ink that does not carbon is very expensive, a printing cost may be increased in a card for play requiring a low price. [0130]

Accordingly, in the present embodiment, in the card arrangement panel (stage surface) , only the card reading portions are printed by using the CMY inks of non-carbon components, and the other portions are printed by using the CMY inks of non-carbon components and the K ink of a carbon component. Therefore, the K component at the card reading portion represents K falsely by the CMY inks of the non-carbon components .

[0131]

As such, it is possible to achieve a structure in which the card arrangement panel (stage surface) can selectively transmit an infrared ray by using only general-purpose inks (CMY inks of non-carbon components and a K ink of a carbon component) . In this case, if an infrared ray component of external light is permeated into the card arrangement panel, it may cause a noise when the dot patterns are read. However, in the present embodiment, the substantially entire surface of the stage surface is made to have an infrared ray non-transmission property and only the reading regions are made to have an infrared ray transmitting property, such that the noise can be reduced.

[ 0132 ]

Further, the color tone in the portions where printing is performed by using only the CMY inks of non-carbon components becomes brighter than the color tone in the portions where printing is performed by using the CMY inks of the non-carbon components and the K ink of the carbon component. For this reason, in the card reading portion where the irradiated light needs to be irradiated, since the color tone is dark, it is possible to avoid light from being not sufficiently irradiated onto the card reading portions.

[0133]

In the present embodiment, not only a glass plate but also another transparent plate made of acrylic or the like may be used.

[0134]

Further, in the present embodiment, it is possible to use a structure in which holes are formed in portions where light is irradiated by the sensors of the card arrangement panel so as to be used as reading holes, and the reading holes are covered with a glass plate so as to prevent dusts from being entered. In this case, when a player puts cards on the card arrangement panel, since the reading holes are completely closed, the IR filter on the sensor does not need to be provided.

[0135]

Fig. 7 is a diagram illustrating a case in which the IR

filter is provided on a glass plate. Fig. 7A is a diagram illustrating the card arrangement panel when viewed from the upper side, and Figs. 7B and 7C are longitudinal cross-sectional views illustrating an enlarged sectional structure of the card arrangement panel.

[0136]

As shown in Fig. 7B, the IR filter is laminated on the bottom surface of the glass plate. By using the IR filter, it can be prevented that the card arrangement panel becomes dark, and inner elements, such as sensors, are viewed by a player.

[0137]

As such, when the IR filter is mounted on the card arrangement panel (stage surface) , since a player cannot view an inner portion of the card arrangement panel, visual quality of the card arrangement panel cannot be improved. However, when the player performs a card game, since it is difficult for the player to view the card reading portions, the player cannot determine locations where the cards should be arranged on the card arrangement panel. For this reason, in a structure shown in Fig. 7A, card arrangement location marks are provided such that the player can know locations where cards should be arranged.

[0138]

In the invention, not only a glass plate but also another

transparent plate made of acrylic or the like may be used as the card arrangement panel . Further, instead of the IR filter, a color filter may be used. Since the color filter cannot be obtained at a lower cost than the IR filter, it is possible to reduce the manufacture cost. Further, when the color filter is used, the IR filter provided on the sensor does not need to be provided, as shown in Figs. 3 and 4.

[0139]

Fig. 7C is a diagram illustrating a case in which an IR filter is provided below a portion of the glass plate that corresponds to the card reading portion, and black filters are mounted on the other portions. By using this structure, the IR filter does not need to be provided at the side of the sensor unit (side of the imaging unit) , and the cost can be reduced, as compared with a case- in which the IR filters are disposed on an entire surface of a lower layer of the card arrangement panel .

[0140]

Fig. 8 is a plan view illustrating a state in which a game is performed by using the card game machine according to the embodiment of the invention.

[0141]

As shown in Fig. 8, a player stands or sits in front of the card arrangement panel of the card game machine, and a monitor is disposed at the front of the card arrangement panel

when viewed from the player . Three pairs of combinations, each of which has a card arrangement panel and a monitor, and other three pairs of combinations, each of which has a card arrangement panel and a monitor, are disposed to be opposite to each other, and six people shares a card game machine of one unit.

[0142]

That is, one player plays a game with any one of the other five people or the other five people, and cards held by the players are disposed on the card arrangement panel. In addition, in a state in which code values or coordinate values of dot patterns printed on the cards are used as parameters, a game is performed. Further, images or moving pictures for raising the game progress and result, or a stage effect are displayed on a monitor.

[0143]

In Fig. 8, the six card arrangement panels and the six monitors form a game machine of one unit. However, the invention is not limited thereto.

[0144]

<Second Embodiment: Single Sensor Game Machine>

Figs. 9 to 39 are diagrams illustrating a card game machine according to a second embodiment of the invention.

[0145]

Fig. 9 is a perspective view illustrating an outer

appearance of a card game machine, and Figs. 1OA and 1OB are longitudinal cross-sectional views illustrating the card game machine .

[0146]

The card game machine according to the present embodiment is constructed such that an entire bottom surface of the card arrangement panel is photographed by one sensor unit (imaging unit) .

[0147]

In the space of the bottom surface of the card arrangement panel (space below the stage) , at locations where imaging light irradiated onto the panel surface (bottom surface of the stage) by the sensor unit (imaging unit) is avoided, IRLEDs (irradiation light sources) for irradiating irradiation light onto the dot pattern of the card surface (medium surface) on the panel surface (stage surface) , and a dispersion filter for dispersing the irradiation light on the bottom surface of the panel (bottom surface of the stage) are provided.

[0148]

The dispersion filter is provided in a frame plate shape such that it protrudes to the space of the bottom surface of the card arrangement panel from the sidewalls that constitute the casing of the card game machine. The dispersion filter is composed of a transparent or semi-transparent glass plate or a synthesis resin plate, and fine irregularities are formed

on one surface of the dispersion filter. In addition, the irradiation light by the IRED is dispersed through the dispersion filter, so that the irradiation light can be irradiated onto the entire bottom- surface of the card arrangement panel. Further, when the cards are disposed on the card arrangement panel, the irradiation light is irradiated onto the card surface, and then reflected light is photographed by a sensor unit (imaging unit) .

[0149]

Fig. 1OA is a diagram illustrating a case in which a substantially horizontal frame-shaped dispersion filter is used, and Fig. 1OB is a diagram illustrating a case in which a frame-shaped dispersion filter inclined to a space side is used. The dispersion filter shown in Fig. 1OA can be easily processed and obtained at a low cost. Further, the dispersion filter shown in Fig. 1OB is provided in an inclined direction so as to avoid imaging light from the bottom surface of the card arrangement panel to the sensor unit, and it is constructed such that irradiation light by the IRLED can be effectively irradiated onto the bottom surface of the card arrangement panel .

[0150]

Fig. 11 is a plan view illustrating the card game machine shown in Fig. 9, when viewed from the upper side.

[0151]

Fig. 12 is a block diagram illustrating an inner structure of a card game machine in which a sensor unit and a microprocessor unit (MPU) are provided separately from each other.

[0152]

In the card game machine, only one sensor unit is provided. The sensor unit is connected to the microprocessor unit (MPU) having a frame buffer through a cable. The microprocessor unit (MPU) is connected to the game microprocessor unit, and the game microprocessor unit is connected to the display and the speaker.

[0153]

The inner structure of the card game machine is not limited thereto. For example, as shown in Fig. 13, the microprocessor unit (MPU) having the frame buffer may be connected to the sensor unit, and the microprocessor unit (MPU) may be connected to the game microprocessor unit through the cable. As such, the sensor unit is directly connected to the microprocessor unit (MPU) , and it is possible to process a signal outputted from the sensor at high speed.

[0154]

Figs. 14 and 15 are diagrams illustrating a card arrangement panel of the top surface of the card game machine.

[0155]

Fig.14 is a diagram illustrating a case in which printing

is performed on a top surface of the glass plate, Fig. 14A is a diagram illustrating the card arrangement panel when viewed from the upper side, and Fig. 14B is a longitudinal cross-sectional view illustrating an enlarged sectional structure of the card arrangement panel.

[0156]

As shown in Fig. 14B, the card arrangement panel forms a laminated structure in which a non-carbon ink is applied onto the top surface of the transparent glass plate. The white ink is applied onto the top surface of the glass plate. Further, CMYK inks that do not contain carbon are applied on the white ink.

[0157]

By applying the white ink onto the top surface of the glass plate, it can be prevented that the surface of the card arrangement panel becomes black, and thus contents printed on paper that does not contain a carbon component cannot be viewed.

[0158]

In the present embodiment, not only a glass plate but also another transparent plate made of acrylic or the like may be used.

[0159]

Figs. 15A and 15B are a plan view and a cross-sectional view illustrating a structure in which the IR filter is laminated on the glass plate in the card arrangement panel,

respectively.

[0160]

As shown in Fig. 15B, the IR filter is mounted on the bottom surface of the glass plate. By using the IR filter, it becomes difficult for external light to permeate into the space below the card arrangement panel (space below the stage) by the card arrangement panel provided on the lower layer of the glass plate. Therefore, it is possible to prevent the inner element, such as a sensor, from being viewed by the player.

[0161]

In the card game machine according to the present embodiment, as shown in Figs. 9 to 13, the entire surface of the card arrangement panel is photographed by one sensor unit (imaging unit) . Therefore, the player can dispose the cards at any locations on the card arrangement panel. As a result, the card arrangement location mark shown in Fig. 7 does not need to be provided.

[0162]

In the present embodiment, in the card arrangement panel, not only a glass plate but also another transparent plate made of acrylic or the like may be used.

[0163]

Further, instead of the IR filter, a color filter may be used. Since the color filter can be obtained at a lower

cost than the IR filter, the manufacture cost can be reduced. Further, when the color filter is used, the IR filter on the sensor does not need to be provided, as shown in Figs. 12 and 13.

[0164]

Further, the card arrangement panel is not limited to the example shown in Figs. 14 and 15. For example, in another embodiment, printing may be performed on a portion of the top surface of the panel, and the IR filters may be mounted on the other portions.

[0165]

Next, the dot patterns used in the invention will be described (see Figs. 16 to 23).

[0166]

Fig.16 is a diagram illustrating GRIDl that is an example of the dot pattern of the invention. Fig. 17 is an enlarged view illustrating an example of information dot of the dot pattern and the bit display of the data defined in the information dot of the dot pattern. Figs. 18A and 18B are diagrams illustrating information dots that are disposed on the basis of key dots.

[0167]

A method of inputting/outputting information using the dot pattern of the invention includes a creating process of creating the dot pattern 1, a recognizing process of

recognizing the dot pattern 1, and an output process of outputting information and a program from the dot pattern 1. That is, the dot pattern 1 is obtained as image data by using the camera. First, a reference matrix point dot 4 is extracted, then the dot is not formed at the location where the original reference lattice point dot 4 exists such that the key dot 2 is extracted, and then the information dot 3 is extracted to be digitized and the information region is extracted such that information is digitized. Then, by using the digitized information, the information and the program are allowed to be outputted from the dot pattern 1. For example, the information, such as sounds, or a program from the dot pattern 1 is outputted to an information output device, a personal computer, a PDA or a cellular phone.

[0168]

In the creating of the dot pattern 1 of the invention, in order to recognize the information such as sounds by the dot code creating algorithm, minute dots, that is, a key dot, an information dot, and a reference lattice point dot 4 are arranged according to a predetermined rule. As shown in Fig. 1, in a block of the dot pattern 1 indicating information, reference lattice point dots 4 of 5 x 5 are arranged on the basis of a key dot 2, and information dots 3 are arranged around a virtual lattice point 5 of the center surrounded by the reference lattice point dot 4 of the four points . In the block,

any numerical information is defined. In an example shown in Fig. 1, the four blocks of the dot patterns 1 (in frames shown by thick lines) are disposed parallel to one another . However, the number of the blocks of the dot patterns 1 is not limited to the four.

[0169]

One corresponding information and program may be outputted to the one block or one corresponding information and program may be outputted to a plurality of blocks.

[0170]

When the dot patterns 1 are obtained as image data by using the camera, the reference lattice point dots 4 can correct distortion of the camera lens or photographing from an inclined direction, expansion and contraction of paper, curvature of a medium surface, and distortion at the time of printing. Specifically, a correction function for converting the reference lattice point dots 4 of the distorted four points into an original square shape, that is, the function (X n , Y n ) = f(X n ', Y n ') is calculated, the information dots 3 are corrected by the same function, and a vector of the correct information dots 3 are obtained.

[0171]

If the reference lattice point dots 4 are arranged in the dot pattern 1, in the image data that is obtained by photographing the dot pattern 1 using a camera, distortion due

to the camera can be corrected. Therefore, even when the image data of the dot pattern 1 is obtained by the general-purpose-type camera to which a lens having a large distortion rate is attached, the dot pattern can be accurately recognized. Further, even when the dot pattern 1 is photographed by the camera in a state in which the camera is inclined with respect to the surface of the dot pattern 1, the dot pattern 1 can be accurately recognized.

[0172]

As shown in Fig. 16, the key dots 2 are dots obtained by shifting four reference lattice point dots 4 located at four corners of the block in a predetermined direction. The key dot 2 is a representative point of the dot pattern 1 corresponding to one block indicating the information dots 3. For example, the key dots 2 are obtained by shifting the four reference lattice point dots 4 located at four corners of the block of the dot pattern 1 upward by 0.1 mm. When the information dots 3 indicate X and Y coordinate values, the locations where the key dots 2 are shifted downward by 0.1 mm become coordinate points. However, the numerical values are not limited thereto, and they may be varied according to a size of the block of the dot pattern 1.

[0173]

The information dots 3 are dots that make a variety of information recognized. The information dots 3 are located

at the peripheral portions of the key dot while using the key dot 2 as a representative point. The center surrounded by the four reference lattice point dots 4 is used as the virtual lattice point 5, and the information dot is disposed at an end point represented by the vector while using the virtual lattice point as the starting point . For example, the information dots 3 are surrounded by the reference lattice point dots 4. As shown in Fig. 17, since the dots that are spaced apart from the virtual lattice point 5 by 0.1 mm have directions and lengths represented by the vector, the dots are disposed in eight directions by rotating them in a clockwise direction by 45 degrees, and each of the dots represents three bits. Accordingly, 3 bits x 16 = 48 bits can be represented in the dot pattern 1 of one block.

[0174]

Further, the dots are disposed in eight directions, and each of the dots represents three bits, but the invention is not limited thereto. The dots may be disposed in sixteen directions and each of the dots may represent four bits. That is, various modifications may be made.

[0175]

The diameter of each of the key dot 2, the information dot 3 or the reference lattice point dot 4 is preferably 0.05 mm, when considering the visual quality, precision of printing with respect to the paper quality, a resolution of the camera,

and optimal digitization .

[ 0176]

Further, when considering a necessary information amount with respect to the photographed area and the error of various dots 2, 3, and 4, the intervals between the reference lattice point dots 4 are preferably about 0.5 mm in each of longitudinal and horizontal directions. When considering the errors of the reference lattice point dot 4 and the information dot 3, the deviation of the key dot 2 is preferably about 20% of the lattice interval.

[0177]

The interval between the information dot 3 and the virtual lattice point surrounded by the four reference lattice point dots 4 is preferably within a range of 15 to 30% of the distance between the adjacent virtual lattice points 5. If the distance between the information dot 3 and the virtual lattice point 5 is shorter than the interval, it is likely for the dots to be viewed as the large lump, and it may be visually undesirable as the dot pattern 1. In contrast, if the distance between the information dot 3 and the virtual lattice point 5 is longer than the interval, it is difficult to confirm whether it is the information dot 3 having vector directivity on the basis of any one of the adjacent virtual lattice points 5.

[0178]

For example, as shown in Fig. 18A, in the information dots 3, the lattice interval at which the Ii to Ii 6 are disposed in a clockwise direction from the center of the block on the basis of the key dot is 0.5 mm, and the information dots 3 represent 3 bits x 16 = 48 bits in a matrix of 2 mm x 2 mm.

[0179]

Further, the sub-blocks, each of which has individual information content and does not affect the other information contents, may be additionally provided in a block, which is shown in Fig. 18B. Each of the sub-blocks [Iχ, I2, I3, and I4] , [I 5 , I 6 , I?, and I 8 ], [I 9 , I 10 , In, and I 12 ], and [I X3 , I 14 , I15, and lie] has four information dots 3. Each of the sub-blocks is constructed that each independent data (3 bits x 4 = 12 bits) is expanded in the information dots 3. As such, the sub-blocks are provided, and error checking can be performed in a unit of a sub-block.

[0180]

It is preferable that a vector direction (rotation direction) of the information dot 3 be uniformly set at intervals of 30 to 90 degrees.

[0181]

Fig. 19 is a diagram illustrating an example of the information dot 3 and the bit display of the data defined in the information dot 3, which illustrates another form.

[0182]

Further, in a case in which two kinds of information dots 3, that is, information dots 3 that the distance between the information dots 3 and the virtual lattice point 5 surrounded by the reference lattice point dots 4 is short, and information dots 3 that the distance between the information dots 3 and the virtual lattice point 5 is long are used, and the vector directions are set to eight directions, each of the information dots 3 can represent four bits. At this time, the interval of the information dots that the distance between the information dots and the virtual lattice point is long is within a range of 25 to 30% of the distance between adjacent virtual lattice points 5, and the interval of the information dots that the distance between the information dots and the virtual lattice point is short is within a range of 15 to 20% of the distance between adjacent virtual lattice points 5. However, the center interval between the two kinds of dots 3 is preferably larger than the diameter of the dot.

[0183]

It is preferable that the information dot 3 surrounded by the four reference lattice point dots 4 represent one bit in consideration of the visual quality. However, in order for a large amount of information to be represented without considering the visual quality, one bit is assigned to each vector such that the information dots 3 represent the plurality of bits. As a result, a large amount of information can be

represented. For example, in the vectors of eight directions of a concentric circle, information of 2 bits can be represented by the information dot 3 that is surrounded by the four lattice dots 4. The sixteen information dots of one block represent information of 2 128 bits.

[0184]

Fig. 20 is a diagram illustrating an example of an information dot and bit display of the data defined in the information dot. Fig. 2OA shows a case in which two bits are disposed, Fig.2OB shows a case in which four bits are displayed, and Fig. 2OC shows a case in which five bits are disposed.

[0185]

Figs .21A to 21D are diagrams illustrating a modification of the dot pattern. Fig. 2IA is a diagram schematically illustrating an example in which six information dots are arranged, Fig. 21B is a diagram schematically illustrating an example in which nine information dots are arranged, Fig. 21C is a diagram schematically illustrating an example in which twelve information dots are arranged, and Fig. 21D is a diagram schematically illustrating an example in which thirty six information dots are arranged.

[0186]

In the dot pattern 1 shown in Figs. 16 and 18, sixteen (4x4) information dots 3 are arranged in one block. However, the number of the information dots 3 arranged in one block is

not limited to the sixteen, and various modifications can be made. For example, in accordance with the size of the necessary information amount or the resolution of the camera, the number of the information dots 3 arranged in one block may be 6 (2 x 3) (corresponding to Fig. 21A), the number of the information dots 3 arranged in one block may be 9 (3 x 3) (corresponding to Fig.21B) , the number of the information dots

3 arranged in one block may be 12 (3 x 4) (corresponding to Fig. 21C) , and the number of the information dots 3 arranged in one block may be 36 (6 x 6) (corresponding to Fig. 21D) .

[0187]

Figs. 22A and 22B are diagrams illustrating a case in which in the dot patterns shown in Figs. 16 to 21D, in the dot patterns of the block composed of nine lattice regions of 3 x 3, the arrangement directions of the information dots 3 are varied in only the specific lattice regions (direction regions) , as compared with to the other lattice regions (direction regions) , and the block direction is defined.

[0188]

That is, in Fig. 22A, in the lattice region 34a of the lower left, the lattice region 34b of the center, and the lattice region 34c of the lower right, the information dots 3 are disposed in longitudinal and horizontal directions from the center, and the information dots 3 are disposed in an oblique direction from the center in the other lattice regions .

As such, by arranging the lattice regions 34a, 34b, and 34c, from a shape of the triangle that couples the lattice regions with one another, that is, the relationship of the top 34b with respect to the bottom sides 34a and 34c, it can be recognized that the block is upward.

[0189]

As such, the direction of the block can be defined from the arrangement relationship (in this case, the triangle) of the lattice regions 34a, 34b, and 34c that have changed the arrangement direction of the information dots 3 in the block (have arranged the information dots in longitudinal and horizontal directions from the center) . Thereby, since the information dots 3 can be arranged in all the lattice regions in the block, the information dots 3 can be arranged in all the lattice regions without sacrificing the lattice region for defining the direction of the block.

[0190]

Fig. 23B is a diagram illustrating a case in which the blocks shown in Fig. 23A are coupled with one another two by- two in longitudinal and horizontal directions.

[0191]

In a case in which only one dot pattern is printed on the back surface of the card, it is preferable that the distance between the lattices be about 15 mm, and the size of the dot be about 15% of the distance between the dots. That is, the

dot size is preferably 2 to 2.5 mm, but the invention is not limited thereto . The distance between the dots of the captured image is preferably 14 pixels or more.

[0192]

Figs. 24 to 27 are diagrams illustrating the cards used in the invention and the movement of the cards. Figs. 24 and 25 are diagrams illustrating cards that are used when the game is performed by using the card game machine shown in Fig. 1.

[0193]

Fig. 24 is a diagram illustrating a case in which a plurality of codes are printed in one card.

[0194]

The card surface (medium surface) of the card (medium) is divided into four regions, and dot patterns indicating different code values are printed in the four regions. As such, four kinds of different information can be contained in one card. In this case, if the player moves the cards on the card reading panel (stage surface) , since the region photographed by the sensor unit (imaging unit) is also varied, the parameter of the player is varied.

[0195]

Fig. 24B is a diagram illustrating a case in which the player moves the card having the card surface divided into four regions, and thus the code read by the sensor unit and the direction of the card are varied. When the player firstly puts

the card on the card panel surface, it is assumed that the region of the code 1 exists at the sensor reading location, and the angle between the vertical direction (y axis) of the card arrangement panel and the card is α. In addition, it is assumed that the player moves the card, and thus the region of the code 4 exists at the sensor reading location and the angle between the vertical direction of the card arrangement panel and the card is varied to α 1 . At this time, before the card moves, the sensor unit reads the code 1, and the dot code output controlling unit outputs information corresponding to the dot pattern of the code 1.

[0196]

Further, after the card moves, the sensor unit reads the code 4, and the dot code output controlling unit outputs the information corresponding to the dot pattern of the code 4. In addition, the variation of the code and the variation of the angle before and after the cards moves become parameters, and the game can be varied. For example, even when the dot patterns are read in the order of a code 1 -> a code 4, the game results may be different from each other in the case of the angle α and in the case of the angle β (not shown) .

[0197]

In the card shown in Fig. 24C, xy coordinates for the dot code are defined. Thereby, the dot code and the location of the image of the dot pattern that is read by the sensor unit

are recognized by the microprocessor unit (MPU) in the sensor unit. The recognized data is outputted from the display or the speaker through the game microprocessor unit. That is, when the card moves, the variation of the card location (xy coordinates) and the direction of the card can be read. [0198]

When the player firstly puts the card on the card arrangement panel, it is assumed that the coordinate value of the information dot read by the sensor unit at a predetermined reading location is (x, y) , and the angle between the vertical direction of the card arrangement panel and the card is α. In addition, it is assumed that the player moves the card, and thus the coordinate value of the information dot at the card reading location becomes (x', y') and the angle between the vertical direction of the card arrangement panel and the card is varied to α' . In this case, the variation of the coordinate value and the variation of the angle before and after the card moves become parameters.

[0199]

Fig. 27A is a diagram illustrating a method of calculating an angle of the card shown in Fig. 24. Fig. 27B is a diagram illustrating an example of the dot pattern that is printed on the back surface of the card. The straight line for coupling the lattice point dots with one another is displayed to easily recognize the dot patterns, and the lattice

line is not printed in the actual dot pattern (see Fig. 25A) .

[0200]

As shown in Fig.27A, the angle between the photographing direction, that is, a y direction of the frame buffer, and the direction of the dot pattern is set to α, which is used as the angle of the card. In addition, the coordinates of the reference lattice point dot Pi are set to (xi, yi) , the coordinates of the reference lattice point dot P 2 are set to (X2c Y2) 1 and the distance between P x and P 2 , that is, the interval between the reference lattice point dots is set to 1.

[0201]

First, θ is fixed by x coordinate. In this case, as for θ, when the condition 0 < xi - X 2 is satisfied, G 1 is set to satisfy the condition 0χ = | sin "1 { (xi - x 2 )/l} I, and G 2 is set to satisfy the condition G 2 = 180 - | sin "1 { (xi - x 2 )/l}|.

[0202]

Further, when the condition 0 > xi - X 2 is satisfied, B 1 is set to satisfy the condition Q 1 = 180 + | sin "1 { (x 2 - xi) /I)L and O 2 is set to satisfy the condition θ 2 = 360 - Isin "1 { (x 2

[0203]

Next, θ is fixed by y coordinate. In this case, as for θ, when the condition 0 ≤ yi - y 2 is satisfied, θi is set to satisfy the condition G 1 = cos "1 { (yi - y 2 )/l) , and G 2 is set

to satisfy the condition θ 2 - 360 - | cos λ { (yi - y2)/l}|. [0204]

Further, when the condition 0 > yi - y 2 is satisfied, θi is set to satisfy the condition θi = 180 - | cos "1 { (y 2 - yi) /1} I , and θ 2 is set to satisfy the condition G 2 = 180 + | cos "1 { (y 2

- Yi) /1}|.

[0205]

In this case, θ by each of x coordinate and y coordinate has two values (G 1 , O 2 ) . A θ value when the values calculated by the x coordinate and the y coordinate become equal to each other is selected, and it is set to α.

[0206]

Fig. 25 is a diagram illustrating the relationship among the dot pattern printed on the card surface, the code value, and xy coordinate values .

[0207]

Fig. 25A is a diagram illustrating a dot pattern printed on the surface of the card. The code value and the xy coordinate values are contained in the dot pattern.

[0208]

Fig. 25B is a diagram illustrating a table on which the dot pattern is defined by 32 bits from Co to C 31 . As shown in Fig. 25B, C 0 to C 7 refer to a y coordinate, Cs to C15 refer to an x coordinate, Ci 6 to C 27 refer to a code value, C 2 8 to C30 refer to a parity, and C 31 refers to a management code.

[ 0209]

Theses values are arranged in the lattice region shown in Fig. 25C, and specifically, they are represented as the dots shown in Fig. 25D/

[0210]

As for the coordinate values, as shown in Fig. 26A, a single xy coordinate system may be used in the entire card surface, and as shown in Fig. 26B, four xy coordinate systems maybe used in respective regions divided for respective codes.

[0211]

Fig. 28 is a plan view illustrating a state in which the cards are disposed on the card arrangement panel, when viewed from the upper side.

[0212]

The player can dispose the four cards from A to D on any locations on the card arrangement panel.

[0213]

Fig. 29 is a diagram illustrating an image obtained by photographing the cards disposed on the card arrangement panel by the sensor unit disposed at the side of the bottom surface of the card arrangement panel.

[0214]

As described above, the sensor unit is provided at the lower side in the casing of the card game machine, and photographs the back surface of the card arrangement panel.

Accordingly, the image photographed by the sensor unit is reversed at the left, right, top and bottom sides, as compared with the image shown in Fig. 27. Further, the dot code printed on the back surface of the card is photographed.

[0215]

Fig. 30 is a diagram illustrating a pixel matrix for determining whether the card exists or not. In the pixel matrix, pixels of 16 x 16 form one cell. The predetermined pixels (pixels hatched in Fig. 30) serve as the check pixels.

[0216]

That is, the brightness of check pixel groups set at a predetermined interval (in this case, at an interval of five pixels) is detected. When the brightness is equal to or more than a predetermined threshold value, it is determined that the medium is disposed on the pixel matrix.

[0217]

Hereinafter, it will be described in detail.

[0218]

First, the microprocessor unit (MPU) provided in the sensor unit or the game microprocessor unit divides the photographic region into cells of 18 (longitudinal) x 22 (horizontal), as shown in Fig. 31. Further, each of these cells is divided into pixels of 16 (longitudinal) x 16 (horizontal) . In addition, among the pixels, a bright level (brightness) of the hatched portion in Fig. 30 is measured.

The bright level is represented by 256 stages from 0 to 255. In addition, any threshold value is set, and when the bright level is equal to or more than the threshold value, it is determined that the card or an object, or a hand is disposed at the corresponding location. However, when the bright level is 255, since it corresponds to a white noise, it is determined that the card is not disposed.

[0219]

Fig. 31 is a diagram illustrating a method of analyzing codes of cards.

[0220]

First, as described above, the photographic region is divided into the cells of 18 (longitudinal) x 22 (horizontal) . In addition, the sensor unit scans cells from the first cell at the upper left toward the rightward direction. In this case, since the other portions other than the cards where the dots are formed reflect the infrared rays, the regions where the cards are disposed are photographed to be brighter than the regions where the cards are not disposed. Accordingly, the sensor unit searches the cells photographed to be bright while scanning the cells. When the sensor unit searches the cells photographed to be bright, it is determined that the card is disposed on the corresponding cells. In addition, it is determined by the above-mentioned method whether the dot exists or not. The searching of the bright region and the

determination whether the dot exists or not are sequentially performed, and the dot code printed on the card surface is read.

[0221]

According to the above-mentioned method, it is determined that the card exists on the bright region, and the dot detection is performed on only the bright region. Accordingly, it is possible to reduce the time necessary when the dots are detected.

[0222]

In the present embodiment, since the dots are detected in only the cell (pixels of 16x16) on which the card is disposed, it is possible to efficiently perform the calculation by the microprocessor unit (MPU) or the game microprocessor unit. Accordingly, it is possible to reduce a time necessary when the dot patterns are read.

[0223]

Fig.32 is a diagram illustrating a method of recognizing the locations of the cards disposed on the card arrangement panel (stage surface) and the angles of the cards, when a game is performed by using the card game machine and the cards according to the invention.

[0224]

First, if the sensor unit photographs the dot pattern of the card surface by using the above-mentioned method, the microprocessor unit (MPU) detects a code value that

corresponds to the dot pattern. After detecting the code value, the microprocessor unit (MPU) searches the key dot. The x and y coordinates of the center of the card are calculated, and they are set to the location of the card. The location of the card is represented by x and y coordinates on the basis of the lower right of the card arrangement panel (upper left when being photographed) . That is, by detecting the location of the card, the center of the card is calculated, and the x and y coordinates of the card are calculated. Thereby, the location of the card is calculated. That is, in Fig. 32, the coordinates of the card A become (x a/ y a ) , the coordinates of the card B become (Xb, yb) t the coordinates of the card C become (x c , y c ) , and the coordinates of the card D become (xa, y < j) -

[0225]

Further, the angle between the straight line coupling the card center and the key dot and the vertical direction of the card arrangement panel is set to α, which is a direction of the card. The angle of the card is calculated by the above-mentioned method.

[0226]

Fig.33 is a diagram illustrating a method of calculating the moved angle and the movement amount, when the user moves the card on the card arrangement panel (stage surface) .

[0227]

According to the method of recognizing the movement of

the card, for example, as shown in Fig. 30, after the pixel matrix on which the card is disposed is detected by the sensor unit and the microprocessor unit (MPU) , the code value is read from the dot pattern, and the key dot is searched. Thereby, the direction of the card on the card arrangement panel can be recognized. When the user moves the card on the card arrangement panel, it is assumed that the card having the same code value moves on the card arrangement panel. Accordingly, if the locations where the code values are reproduced per predetermined time are coupled as the traces, whether the card moves or not, the movement direction of the card, and the movement traces of the card can be recognized.

[0228]

Further, the microprocessor unit (MPU) can know the rotation angle by movement by using the difference between the directions of the key dots before and after the card moves. Further, it can calculate the movement amount and the movement time.

[0229]

As such, the power of the card holder can be varied according to the card locations, or the game may be progressed while using the movement amount or the moving time as parameters .

[0230]

Hereinafter, Fig. 33 will be described in detail.

[ 0231 ]

As shown in Fig. 33, it is assumed that the player moves the cards A, B, C, and D. At this time, the center of the card A moves from- (x a , y a ) to (x a ? , Y a 1 )^ the center of the card B moves from (x b , y b ) to (x b ' , y b ' ) , the center of the card C moves from (x c , y c ) to (x c ' , y c ' ) , and the center of the card D moves from (x d , y d ) to (x d ', yd')- At this time, as for the angle with respect to the card arrangement panel, the card A is changed from α a to α a ', the card B is changed from α b to α b ', the card C is changed from α c to oc c ' , and the card D is changed from α d to α d ' . In this case, the movement amount l a of the card A satisfies the following condition.

Ia = V { (x a ' - X 3 ) 2 + ( Ya 1 - y a ) 2 }

[ 0232 ]

Further, the rotation angle θ a satisfies the following condition. θ a = α a ' -α a

[0233]

Further, if the time before the card moves is set to T a and the time after the card moves is set to T a ', the time t a necessary for card movement satisfies the following condition. t a = T a ' - T a

[0234]

This is applicable to cards B, C, and D. [0235]

In the card game machine, if the player moves the card, the movement amount of the card, the rotation angle of the card, and the movement time of the card become parameters, and the power of the card holder is varied. That is, when the card moves, the intensity of the power of the card holder varies.

[0236]

Figs. 34A and 34B are diagrams illustrating a case in which the traces of the card are used as parameters. Fig. 34A is a diagram illustrating a case in which a card moves in a circular shape, and Fig. 34B is a diagram illustrating a case in which a card moves in a rectangular shape.

[0237]

In the invention, the traces when the player moves the card may be used as parameters. For example, the shape of the trace can be used as the parameter. That is, the player moves the card in a curve shape as shown in Fig. 34A, or moves the card in a linear shape as shown in Fig. 34B, so that parameter such as the attribute of the card may be varied.

[0238]

In another embodiment, the characters displayed on the display may be associated with the traces of the cards on the card arrangement panel to be controlled. For example, a stage effect that battle planes are displayed on the screen, and the player moves cards and thus the battle planes move according to the movement of the cards can be made.

[ 0239 ]

Further, the cards may be moved in a state in which the locations and the directions of a camera (not shown) on the card arrangement panel are associated with the traces.

[0240]

In this case, if the card does not move for a predetermined time or more, it may be assumed that the traces of the card are completed. Further, if the player removes the card from the card arrangement panel, it may be assumed that the traces of the card are completed.

[0241]

Fig. 35 is a plan view illustrating a state in which a game is performed by the card game machine of the invention.

[0242]

As shown in Fig. 8, a player stands or sits in front of the card arrangement panel of the card game machine, and a monitor is disposed at the front of the card arrangement panel when viewed from the player . Three pairs of combinations, each of which has a card arrangement panel and a monitor, and other three pairs of combinations, each of which has a card arrangement panel and a monitor, are disposed to be opposite to each other, and six people shares a card game machine of one unit.

[0243]

That is, one player plays a game with any one of the other

five people or the other five people, and cards held by the player are disposed on the card arrangement panel. A game progresses while using code values or coordinate values of dot patterns printed on the cards.- In addition, images or moving pictures for raising the game progress and result, or a stage effect are displayed on a monitor.

[0244]

In Fig. 8, the six card arrangement panels form a game machine of one unit. However, the invention is not limited thereto.

[0245]

Figs. 36 to 39 are diagrams illustrating a card game machine according to a second embodiment of the invention in which an image is displayed on the card arrangement panel.

[0246]

In the second embodiment, in addition to the sensor unit (imaging unit) , a projector that serves as a projection unit is provided in a space below the card arrangement panel (space below a stage) . In the projector, images or moving pictures that are projected onto the stage surface are controlled by code values or coordinate values of the dot patterns obtained from the photographed image by the sensor unit.

[0247]

In the present embodiment, for example, if a card where the dot patterns are printed is disposed on the card arrangement

panel, the infrared ray irradiation light irradiated from the IRLEDs is irradiated onto the entire bottom surface of the card arrangement panel through the dispersion filter.

[0248]

The infrared ray irradiation light reflected on the back surface of the card is photographed by the sensor unit. At this time, from the projector, images or moving pictures are projected onto the bottom surface of the card arrangement panel .

[0249]

In addition, if the sensor unit and the microprocessor unit (MPU) read the dot pattern printed on the card, the dot pattern is converted into the code value, and the image or the moving picture corresponding to the code value is projected from the projector.

[0250]

As such, the images or the moving pictures are projected onto the bottom surface of the card arrangement panel by the projector, and the projected images and moving pictures are controlled by the cards which are disposed on the card arrangement panel and on which the dot patterns are printed.

[0251]

Fig. 37 is a longitudinal cross-sectional view illustrating the card game machine according to the present embodiment .

[ 0252 ]

As shown in Fig. 37, an upper layer of the card arrangement panel is formed of a transparent plate made of glass or acrylic, and a screen sheet for a rear projector is laminated on a lower layer of the card arrangement panel. In the space below the card arrangement panel (space below the stage surface) , a projector for projecting images or moving pictures onto the screen sheet, IRLEDs for irradiating infrared light onto the bottom surface of the card arrangement panel, a dispersion filter for dispersing the infrared light, and a CCD (sensor unit) serving as an imaging unit are provided. Further, an IR filter is mounted on the front end of the CCD. [0253]

In Fig. 37, the CCD is connected to a microprocessor unit (MPU) (not shown) , and the images photographed by the CCD are analyzed by the microprocessor unit (MPU) , and thus the dot pattern printed on the back surface of the card is converted into a code value or a coordinate value. [0254]

Referring to Fig.38A, a mirror is provided to be inclined in a space below the card arrangement panel (space below the stage) , a projector (imaging unit) is disposed at the side of one surface of the mirror, the projected images or moving pictures from the projector (projection unit) are reflected on one surface of the mirror to be projected onto the bottom

surface of the stage. In the space below the card arrangement panel at the location spaced apart from the mirror, a CCD serving as an imaging unit is disposed, and the photographed light of the dot pattern of the card surface (medium surface) on the card arrangement panel (stage surface) is incident onto the imaging unit without being incident on the mirror.

[0255]

Referring to Fig. 38B, a magic mirror is provided to be inclined in a space below the card arrangement panel (space below the stage) , a projector (projection unit) is disposed at the side of one surface of the magic mirror, the projected images or moving pictures from the projector (projection unit) are reflected on one surface of the mirror to be projected onto the bottom surface of the stage. The CCD (imaging unit) is disposed at the side of the other surface of the magic mirror, and the photographed light of the dot pattern of the medium surface on the stage surface transmits the magic mirror to then be incident on the CCD (imaging unit) .

[0256]

Figs. 39A to 39C are diagrams illustrating images projected onto the card arrangement panel, when the game is actually performed. For example, first, an image of 'a Janken game' is displayed on the card arrangement panel. In this case, the player puts a card on which a predetermined pattern (in this case, ID of the player) is printed on a display location

of a start (see Fig. 39A) . At this time, the IRLED below the card arrangement panel irradiates the infrared light onto the card through the dispersion filter.

[0257]

The CCD (imaging unit) that has photographed the light reflected from the card transmits the photographed image to the microprocessor unit (MPU) . Then, the microprocessor- unit (MPU) recognizes the dot pattern from the photographed image, and reads the code value (in this case, ID of the player) that corresponds to the dot pattern.

[0258]

Then, the game microprocessor unit (see Figs. 12 and 13) that has received the code value from the microprocessor unit (MPU) controls the projector, and displays the game start image on the card arrangement panel (Fig. 39B) .

[0259]

When the game starts, if the player moves the card, the location of the card after the movement (coordinate value on the card arrangement panel) is recognized by the microprocessor unit (MPU) and the game microprocessor unit. In this case, the microprocessor unit (MPU) and the game microprocessor unit recognize that the card is disposed at a location of a 'rock' of scissors-paper-rock.

[0260]

Next, the game microprocessor unit generates random

numbers, and determines a card at the side of the game microprocessor unit (in this case, 'scissors') on the basis of values of the random numbers.

[0261]

Then, the game microprocessor unit determines a game. The game determination is performed on the basis of a determination table set in the memory (not shown) . As a result of referring to the determination table, when it is determined that the player wins (Fig. 39D), points are added to an ID attribute of the player.

[0262]

<Another Embodiment>

Figs.36 to 39 are diagrams illustrating an example where images or moving pictures are directly projected onto the card arrangement panel by the projector. However, as shown in Fig. 40, the monitor (display) may be separately provided from the card arrangement panel.

[0263]

Further, as shown in Fig. 41, the sensor unit may have a rail that is movable in xy directions.

[0264]

Further, as shown in Fig. 42, the sensor unit serving as an image input unit may be provided such that it can scan a surface of the guide rail by a driving belt of a stepping motor, and may read the dot pattern of the medium that is

disposed on a document platen made of glass.

[0265]

Fig. 43 is a diagram illustrating a household game machine in which dot patterns of the card can be read by a main body of the game machine. The read result can be displayed on a monitor of an external television. A memory card can be mounted on the main body of the game machine. In the memory card, the scoreline or the parameter of the card, and the images or moving data may be stored.

[0266]

Figs. 44 to 46 are diagrams illustrating a modification of the game machine. As shown in Fig. 45, the card may be scanned in a horizontal direction.

[0267]

As shown in Fig. 47, the dot patterns may be printed on both sides of the card, the dot pattern of the bottom surface of the card may be read by a main body of the game machine, and the dot pattern of the bottom surface of the card may be read by a pen-type scanner. Since the same structure is used in Fig. 48, the repetitive description is omitted.

[0268]

Figs. 49 and 50 are diagrams illustrating a game machine in which a plurality of cards are disposed in a sensor unit and thus dot patterns of the plurality of cards are simultaneously read by the sensor unit . As such, the plurality

of cards are simultaneously read by combining the plurality of cards, and thus a combination of parameters of the game becomes further complicated.

[0269]

In this case, the cards are set in the game machine while moving slightly in a longitudinal direction. As shown in Fig. 52, a transparent card case for accommodating a plurality of cards at slightly shifted locations may be prepared. Fig. 51 is a diagram illustrating dot pattern forming surfaces of the used card.

[0270]

Further, as shown in Figs. 53A and 53B, instead of the card, the medium may be a figure that has a bottom surface on which dot patterns are formed. The stage is formed in a circular shape, and the top surface of the stage serves as the stage surface on which the figure can be disposed. On the stage surface, the glass plate and the IR filter are laminated. In an inner space of the stage, IRLEDs, dispersion filters, and a sensor unit are provided.

[0271]

As such, even when the figures are used instead of the cards, output information according to the locations of the figures, the directions of the figures, and the distance between the figures on the stage surface, for example, words may vary. For example, a conversation when figures are placed

in face to face and a conversation when the figures are placed in back to back may be different from each other in conversation contents. At this time, the directions of the figures or the distance between the figures is the same as that in the case of the card illustrated in Fig. 32, and thus the description thereof will be omitted.

[0272]

<Embodiment with Changed Infrared Characteristic

Figs. 54 to 68 are diagrams illustrating an embodiment when one system of dot pattern or a plurality of systems of dot patterns of two or more of systems of dot patterns formed of at least two kinds of inks having different reactivity, printed on the medium, are selectively or overlappingly read.

[0273]

Fig. 54 is a diagram illustrating an example when dot patterns are formed by using two kinds of inks having different infrared ray absorptivity. The difference between the infrared ray absorptivity can be made by controlling a carbon component contained in the ink.

[0274]

Fig. 54 shows an example when as at least two kinds of inks having different reactivity, two kinds of inks having different infrared ray absorptivity are used in all frequency bands, that is, any frequency.

[0275]

In the present embodiment, the structure of the information output device is the same as that of other embodiments .

[0276]

In Fig. 54, an ink a has infrared ray absorptivity of about 80% in a peak wavelength of 850 run, and an ink b has infrared ray absorptivity of about 60% in the same peak wavelength.

[0277]

When the dot patterns are printed by using two kinds of inks a and b, as shown in Fig. 55, the dot of ink a that has high infrared ray absorptivity of about 80% in a peak wavelength is recognized to be dark, and the dot of ink b that has low infrared ray absorptivity of about 60% in a peak wavelength is recognized to be bright. The dot formed by the ink b is assumed as a false dot, and a dot pattern having the meaning in only the dot formed by the ink a is formed. Generally, at the time of fabrication, the dot of the ink b is also copied without being discriminated from the dot of the ink a. Therefore, the noise due to the ink b permeates into the copied dot pattern, and the reproducibility of the dot pattern by the ink a cannot be ensured. As a result, it is not possible to raise the security.

[0278]

Fig. 56 is a diagram illustrating a case in which three

kinds of inks, each of which has different peak value wavelength characteristic of infrared ray absorptivity, are used. [0279]

The ink a has a peak wavelength of 850 run, the ink b has a peak wavelength of 900 ran, and the ink c has a peak wavelength of 950 nm. The dot patterns are printed by the inks a, b, and c.

[0280]

Meanwhile, the LED that serves as the infrared ray irradiating unit selectively or overlappingly irradiates light onto the dot patterns by using an LED-A having wavelength characteristic of 850 nm, an LED-B having wavelength characteristic of 900 nm, and an LED-C having wavelength characteristic of 950 nm. Figs. 57A to 57C show darkness and brightness of the dot in a case in which light is selectively irradiated by using the LED-A to the LED-C.

[0281]

Fig. 58 is a diagram illustrating brightness of the dot in a case in which printing is performed by overlapping the inks a, b, and c with respect to the lattice point dots (four corners) . As such, since the lattice dots are printed by all inks, even when light is irradiated by any LED, only the lattice point dot may be obviously recognized. For this reason, if the lattice point dot is recognized, the location of the lattice point dot may be stored in the memory, and thus even the light

source is changed, the reading efficiency can be improved.

[0282]

Fig. 59A is a diagram illustrating a case in which a first ink (ink a) having a small peak value of infrared ray absorptivity and a small wavelength and a second ink (ink b) having a large peak value ofinfrared ray absorptivity and a large wavelength are used.

[0283]

In the present embodiment, an infrared ray entire region light source (first illumination unit) , and a second illumination unit (LED-A) are prepared. The second illumination unit is suitable for a wavelength (in this case, 850 ran) in which the infrared ray absorptivity of the first ink is higher than infrared ray absorptivity of the second ink.

[0284]

Figs. 60A to 61B are diagrams illustrating recognized degrees of the dots, when an infrared ray entire region light source is turned on (Fig. 6OA and Fig. 61A) , and when the LED-A is turned on (Fig. 6OB and Fig. 61B) .

[0285]

As can be understood from these drawings, when the infrared ray entire region light source is turned on, the ink b having the high infrared ray absorptivity is recognized to be dark, and when the LED-A is turned on, the ink a having the high infrared ray absorptivity in a wavelength of 850 nm is

recognized to be dark. Further, when the inks a and b are printed to overlap each other with respect to the lattice point dot, even when any light source is turned on, the lattice point dot is recognized to be dark.

[0286]

Further, in the present embodiment, as shown in Fig. 59B, an ink having a large peak value of infrared ray absorptivity and a small wavelength may be used as a first ink, and an ink having a small peak value of infrared ray absorptivity and a large wavelength may be used as a second ink.

[0287]

Figs. 62 to 64 are diagrams illustrating a control method in a case in which a single infrared ray irradiating light source whose wavelength characteristic varies is used, when the inks a and b, each of which has different peak wavelength characteristic, are used.

[0288]

As shown in Figs. 63 and 64, by changing the wavelength characteristic, recognized degrees for the inks a and b may be different from each other.

[0289]

Figs. 65 to 67 are diagrams illustrating variation of the dot recognition degree when using inks a and b with different peak wavelength characteristic, the infrared ray irradiating light sources LED-A and LED-B suitable for the inks

a and b, and an infrared filter transmitting only the infrared light by the LED-B. [0290]

As such, the filter that selectively transmits the infrared wavelength of the ink b is used. As shown in Figs. 66 and 67, the filter is selectively disposed, and the dot recognition degrees by the inks a and b may be different from each other.

[0291]

Fig. 68 is a diagram illustrating an example of the dot pattern in a case in which the two kinds of dots using the difference between the infrared ray wavelength characteristics by the above-described inks are selectively adopted.

[0292]

For example, Fig. 68 shows a case in which when the two kinds of dots having the different infrared ray absorptivity are recognized, as described in Figs. 54 and 55, the dots printed by the ink a and recognized to be dark (dots printed to be dark in Fig. 68) , and the dots printed by the ink b and recognized to be bright (dots hatched in Fig. 68) are selectively read. In Fig. 68, the dots surrounded by O are selected. That is, the selection table is set on the memory of the information output device, and for example, in the lattice block of Fig. 68, the dot of the ink a is selected in

a lattice region of the left of an upper stage, the dot of the ink b is selected in a lattice region of the center of the upper stage, the dot of the ink a is selected in a lattice region of the right of the upper stage, the dot of the ink b is selected in a lattice region of the center of a middle stage, the dot of the ink a is selected in a lattice region of the right of the middle stage, the dot of the ink b is selected in a lattice region of the left of a lower stage, the dot of the ink a is selected in a lattice region of the center of the lower stage, and the dot of the ink b is selected in a lattice region of the right of the lower stage. In this way, the dots are selectively read. As such, the dots are read on the basis of the selection table such that correction information is first outputted. Therefore, it is possible to ensure very high security.

[0293]

In the above-described description, the case in which the dot patterns are printed on the card as the medium has been described, but the invention is not limited thereto. For example, instead of the dot patterns, a RFID chip shown in Fig. 69, a magnetic recording unit made of magnetic stripes shown in Fig. 70, and an IC chip shown in Fig. 71 may be complexly built in the card.

[0294]

The composite card having the storage unit is used, and

thus the score of the player may be stored.

[0295]

Fig. 72 is a diagram illustrating a specific example of a Whack-A-Mole game machine using the embodiment of the invention, and Fig. 73 is a cross-sectional view illustrating the stage surface of the Whack-A-Mole game machine.

[0296]

In the present embodiment, dot patterns are printed on a surface of a hammer held by the player. Further, on the transparent sheet of the stage surface that is coated by a white color, a background color of a field of grass is printed, and mole projection portions are provided at several locations of the stage surface. As shown in Fig. 73, in the mole projection portion, a dispersion filter is inserted, instead of a transparent sheet layer coated by a white color and a CMYK ink layer that does not contain carbon. In addition, a glass plate or a transparent plate made of acrylic or the like is disposed on the CMYK ink layer that does not carbon and the dispersion filter.

[0297]

In the mole projection portions, the characters of the moles are randomly projected from the bottom surface of the stage by the projector per predetermined time. In a case in which the characters of the moles are projected, when the surface of the hammer is located on the mole projection portion,

the dot pattern of the hammer surface is read by a sensor unit provided in the space below the bottom surface of the stage. In this case, the dot pattern is analyzed, and converted into a code value set for each hammer surface, and the score is added by the game microprocessor unit. Further, in a case in which the characters of the moles are not projected in the mole projection portions, even when the hammer surface is located on the mole projection portion, the score at this time is not added. Further, when the mole characters are not projected in the mole projection portions, the sensor unit may be programmed such that the sensor unit does not perform the imaging process of the dot pattern.

[0298]

As described above, the different code values are printed as the dot patterns for every hammer surface. When a hammer for a high-level player (a hammer where a dot pattern indicating a code value for a high-level player is printed on a hammer surface) is used in a game, the game microprocessor unit that has read the dot pattern of the surface of the hammer for the high-level player performs control for reducing the projection time of the characters of the moles at the mole projection portions with respect to the projector, such that a degree of difficulty of the game is raised.

[0299]

In the above-described description, the dot patterns are

formed on the hammer surfaces. However, the dot patterns may be printed on the cards, or the dot patterns may be printed on the bottom surfaces of the figures.

[0300]

In the above-described embodiments, as the media, the cards, the figures, the hammers for a game, and the like have been exemplified. The different ink characteristic or the irradiation light of the different characteristic is used, and the selectivity of the dot pattern is widen, which results in raising the security. Therefore, the invention may be applied to the counterfeit preventing subject media, such as a tag, a certificate (identification certificate, and a passport) , an exchange ticket for money, a ticket, and the like. Further, any one of the RFID tag, the magnetic storage unit, or a memory composed of an IC chip may be built in the counterfeit preventing subject media.

[0301]

[Another embodiment]

(Corresponding to the thirty second aspect of the invention)

Figs .74A to 74D are diagrams illustrating a case in which the cards are used as the media. In Figs. 74A to 74D, on the surfaces of these cards, a kind of a trump as a picture

(corresponding to Fig. 74A) , an alphabetic letter like A

(corresponding to Fig. 74B) , a two-dimensional code

(corresponding to Fig. 74C) , and the dot pattern (Fig. 74D) are printed. However, if they are photographed by the imaging unit and then reproducible as code information by the information processing unit, it is possible to use any one of pictures, characters, diagrams, codes, and patterns.

[0302]

The pictures, the characters, the diagrams, the codes, and the patterns are printed by the inks having the infrared ray absorbing characteristic.

[0303]

Fig. 75 is a perspective view illustrating a card game machine according to the present embodiment. Figs. 76 and 77 are perspective views illustrating a portion of the card game machine.

[0304]

The main body of the card game machine has a stage casing, and a projection panel serving as a stage surface is formed on the top surface of the stage casing in a horizontal direction.

[0305]

Further, in the casing, an infrared camera serving as an imaging unit is provided. The bottom surface of the projection panel is photographed through the mirror that is disposed in an oblique direction. Further, a projector is provided in parallel to the infrared camera, and the multimedia

information, such as characters, diagrams, images, moving pictures, and the like, can be displayed on the bottom surface of the projection panel through the mirror.

[0306]

Further, at the side opposite to the side where the player is located with respect to the projection panel, the display is provided, and the player can play a game while viewing the projection panel and the display at hand.

[0307]

Although not shown in Figs .75 to 77 , the infrared camera, the projector, and the display may be connected to the information processing device, such as a personal computer and the like, so as to be controlled.

[0308]

Further, although not shown in the drawings, in the casing, the infrared ray irradiation units, such as the IRLEDs, that irradiates light onto the bottom surface of the stage, are disposed with the same structure as those shown in Figs. 36 to 38.

[0309]

In addition, to the information processing device, o " n the basis of the projection image from the infrared camera, the location information of the card serving as the medium on the stage surface, the direction information of the card or medium state information such as a state of the contact surface

between the projection panel surface and the card, and information of codes printed on the medium surface are inputted, and the medium state information, multimedia information, such as characters, images, moving pictures, and the like, that corresponds to the code information, are outputted and displayed on an entire surface or a portion of the stage surface composed of a projection panel by the projector.

[0310]

As such, the code information printed on the card is photographed by the infrared camera, and multimedia information, such as sounds, characters, images or moving pictures, corresponding to the code information, is displayed on the surface of the stage on which the medium is disposed, and the display production associated with the code information of the card can be made.

[0311]

Fig. 78 is a diagram illustrating the card on the projection panel and a display example of the multimedia information. In this case, marks indicating the card waiting regions are displayed at the player side, and the cards are disposed in the waiting regions in an initial state of a game. The top surface of a tank is printed on the surface of the card, and the code information of the tank is printed on the back surface of the card as the dot pattern shown in Figs. 16 to 27.

[ 0312 ]

If the player moves the card from the waiting region, the moving state is photographed by the infrared camera, and the movement of the card is recognized by the information processing device. At this time, the arrangement or movement of the card can be recognized by methods shown in Figs. 28 to 34.

[0313]

In the information processing device, the arrangement or movement state of the card is recognized, and image or moving picture information that is associated with the arrangement location or the operation state is read from a storage device (hard disk device (not shown) ) , or sequentially calculated, and displayed on the projection panel through the projector. At this time, image or moving picture information corresponds to an image of a shell from the tank or an image of desert dusts when the tank moves in the desert, and an image of a caterpillar trace remaining in the desert. These images are associated with the cards, and projected onto the peripheral portions of the cards. As a result, when the card game is performed, the realistic sensation of the game can be raised.

[0314]

Figs. 85 to 87 are diagrams illustrating different multimedia information. That is, on the surface of the projection panel, an instruction necessary when the game is

performed, such as ' attack a B point ' , or the score or parameter of the game varied by the cards or the figures disposed on the projection panel, such as 'HP + 50', 'MP - 20', and the like, can be displayed (see Fig. 85) , the balloon display of the statement of the figure of 'Does shadow of A act?' are made (see Fig. 86) , and the instruction indicating the movement and the movement destination of the card (see Fig. 87) can be displayed.

[0315]

As such, the arrangement or operation instruction of the medium is made by the multimedia information displayed on the projection panel surface, and thus the medium can be easily operated. The stage effect of the game or the like can be raised.

[0316]

Further, the information processing device outputs information indicating the characters, diagrams, images or moving pictures associated with the card or figure at the locations that do not overlap the contacting surface of the recoding medium or the card previously disposed on the projection panel surface.

[0317]

For example, when the plurality of cards are disposed on the surface of the projection panel, the multimedia information indicating characters, diagrams, images, moving

pictures, or the like can be displayed at the locations shifted from the disposed cards (see Figs. 85 and 87). It can be achieved, when the information processing device can recognize the location of the card on the projection panel surface illustrated in Fig. 31.

[0318]

Further, in the case of the figure (doll) having a bottom surface on which the code information is printed, when the player views the figure from the oblique upper side, the multimedia information indicating characters, diagrams, images, moving pictures, or the like can be displayed at the locations where the shadow of the figure is not formed, when viewed from an eye line (see Fig. 85) .

[0319]

Further, in the dot pattern that is printed on the medium surface of the card or the figure, medium information that indicates a kind of a medium, a shape of the medium, or the shape of the medium surface is defined, and on the basis of the medium information, information indicating the characters, the diagrams, the images or the moving pictures maybe created.

[0320]

Fig. 95 is a diagram illustrating an example of a format of the dot code when information indicating the kind of the medium, the material quality of the medium, and the shape of the medium surface, and other information are contained. Fig.

96 is a diagram illustrating an example of the medium that is defined by the dot code.

[0321]

In the code information, the medium information indicating the kind or shape of the medium is contained. When the code information is photographed by the imaging unit, since the information processing device can recognize the kind or shape of the medium, the multimedia information corresponding to the code information containing the kind or shape of the medium can be outputted.

[0322]

For example, when using the information indicating kind of the medium of the figure or the card, in the case of the figure, words composed of characters can be displayed on the projection panel surface (see Fig. 86) , and in the case of the card, the score can be displayed on the projection panel surface (see Fig. 85) .

[0323]

Further, when the shape of the medium or the shape of the medium surface is stored as medium information, an algorithm in which the imaging unit directly recognizes the shape of the medium from the photographed image can be omitted. The information indicating the characters, the images, the moving pictures, and the like in consideration with the shape of the medium or the shape of the medium surface can be displayed

on the panel surface.

[0324]

Fig. 78 is a diagram illustrating an example in which the entire surface of the stage is used as the projection region of the projection panel and the infrared ray photographic region. As shown in Fig. 79, the projection panel may be divided into the projection region (upper half of Fig. 79) and the infrared ray photographic region (lower half of Fig. 79) .

[0325]

That is, in the projection region of the upper half, the still image or the moving picture from the projector is displayed, and the infrared ray transmitting printing is performed in the lower half and the still images or moving pictures are not displayed. However, the dot pattern of the back surface of the card disposed in the portions corresponding to the lower half can be read by the infrared camera.

[0326]

In the structure of the projection panel, pictures or characters are printed on a portion or an entire surface of the top surface of the projection panel by using an infrared ray transmitting ink. Alternatively, the infrared ray transmitting sheet that is printed by using the infrared ray transmitting ink may be attached.

[0327]

As such, the pictures or the characters are previously

printed on the top surface of the projection panel by using the infrared ray transmitting ink, and thus it is possible to raise the stage effect combined with multimedia information projected from the lower -side.

[0328]

Further, the infrared ray transmitting sheet is attached, and thus the surface of the projection panel can protected from the damage. Even when the infrared ray transmitting sheet is damaged, it can be easily exchanged with a new one.

[0329]

Figs. 8OA and 8OB are diagrams illustrating another application example. As shown in Fig. 8OA, in the projection panel, an image of a cockpit in the tank is printed, and as shown in Fig. 80B, the projection panel region is divided into a projection region where the printing is not performed, a semi-projection region where the infrared ray transmitting printing is performed and the overlapping projection can be performed, and a non-projection region where the infrared ray transmitting printing is performed but the projection is not performed.

[0330]

As such, the still images or the moving pictures are projected onto the semi-projection region and the projection region by the projector, and thus it is possible to produce the realistic sensation according to the progress of the card

game.

[0331]

Fig. 81A is a diagram illustrating a sectional structure of each region in the projection panel. As shown in Fig. 81A, in the non-projection region, on the top surface of the projection panel, the non-projection/infrared ray transmitting printing is performed by using the ink that does not transmit the projection light, and then the infrared ray transmitting graphic printing is performed thereon. The uppermost layer is coated (or made of a protective transparent sheet) , and the surface is protected. Further, in the semi-projection region, the infrared ray transmitting printing is performed on the top surface of the projection panel, and the uppermost layer is coated. Further, in the projection region, only the coating is performed on the projection panel.

[0332]

In a structure shown in Fig. 81B, the graphic printing sheet is attached to the top surface of the projection panel. In the non-projection region, the sheet where the infrared ray transmitting graphic printing and the non-projection/infrared ray transmitting printing are performed is disposed on the adhesive layer formed on the surface of the projection panel in a state in which a printing surface is downward. In the semi-projection region, the sheet where the infrared ray transmitting graphic printing is performed is disposed on the

adhesive layer at the projection panel surface side in a state in which the printing surface is downward.

[0333]

Further, in the projection region, the sheet is attached to the projection panel with the adhesive layer therebetween. As such, in all the regions, the sheet is disposed on the uppermost layer, and thus the surface of the projection panel can be protected from the damage.

[0334]

Figs.83Ato 83D are diagrams illustrating cases in which a frame designating the projection region projected by the projector or marks designating the four corners of the projection region are printed on the top surface of the projection panel or the infrared ray transmitting sheet.

[0335]

As such, the frame or the marks that are previously provided on the top surface of the projection panel or the infrared ray transmitting sheet are used as earmarks, and the frame or the marks indicating four corners are projected onto the projection panel from the projector. -The designated projection region and the projection region of the projection image, that is, marks of them are corrected such that they align with each other.

[0336]

Thereby, it is possible to easily correct (calibrate)

the deviation of the proj ector with respect to the proj ection panel .

[ 0337 ]

Fig. 84 is a diagram illustrating a state in which the dot mark designating the four corners of the region for photographing the infrared image is printed on the top surface of the projection panel or the infrared ray transmitting sheet by using the infrared ray absorbing ink.

[0338]

The information processing unit recognizes the coordinates of the four corners on the basis of the dot marks photographed by the infrared camera, determines whether the coordinates of the four corners are at the same locations as the corner information of the photographic region previously stored in the storage unit, and allows the result information and the adjustment instruction information to be displayed on the projection panel by the projection unit. Specifically, as shown in Fig. 84, the character information instructing the adjustment of the deviation can be displayed on the projection panel as follows: (1) Please rotates an infrared camera at the right side by 10°. (2) Please reduces a photographic region of the infrared camera downward by 5%. (3) Please moves the infrared camera at a right side by 2 cm. (4) Please moves the infrared camera downward by lcm. Further, numerals surrounded by () refer to numerals surrounded by circles in

the corresponding drawing .

[ 0339]

Figs. 82A to 82C are diagrams illustrating examples of printing the projection region instructing frame and the photographic location correction dot mark for correcting the deviation of the projection panel with respect to the projector and the infrared camera. Fig. 82C is a diagram illustrating a correcting transparent sheet used when the projection region instructing frame and the photographic location correction reference dot mark are not printed on the projection panel or the infrared ray transmitting sheet. In this case, after the correction, the correcting transparent sheet may be removed.

[0340]

Figs. 88 to 94 illustrate the manipulation or operation of the card or the figure on the projection panel or a method of recognizing them.

[0341]

Fig. 88 is a diagram illustrating a grid tapping operation of the medium on the surface of the projection panel, that is, an example when XY coordinate information and/or code information calculated in the same region as the location whether the medium is disposed or in the designated region is read many times in the predetermined time. Fig. 88A shows an example of a card, Fig. 88B shows a handle which has an adhesive layer to be freely attached to or detached from the surface

of the card (surface opposite to the back surface on which the dot pattern is printed) , and Fig. 88C shows an example of the figure .

[0342]

When the grid tapping operation by the card or the figure is performed on the surface of the projection panel, first, the infrared camera reads the dot pattern printed on the back surface of the card or the bottom surface of the figure, and recognizes the dot codes. Then, when the brightness of the reflective light by the infrared camera vary in a range of the same bottom surface shape as the shape of the bottom surface of the medium, the information processing device determines that the grid tapping operation is performed on the surface of the projection panel, and performs the process corresponding to the operation, for example, a process for increasing a parameter of a striking power.

[0343]

Fig. 89 shows a grip twist operation.

[0344]

The grid twist operation corresponds to an operation for rotating the medium on the basis of any location of the medium surface on the surface of the projection panel. In this case, the rotation angle of the medium with respect to the direction of the imaging unit or the trace of the rotation angle is repeatedly recognized in a predetermined time, and the

information processing device determines that the grid twist operation is performed and performs a process corresponding to the operation, for example, a process of increasing a parameter of a defensive skill.

[0345]

Fig. 90 is a diagram illustrating a grid sliding operation.

[0346]

The grid sliding operation can be determined by sliding the medium on the surface of the projection panel in a circular shape and recognizing the trace of the XY coordinate information calculated in the predetermined time in a substantially circular shape. When the information processing device determines that the grid sliding operation is performed, the information processing device performs a process corresponding to the grid sliding operation, for example, a process of increasing a parameter of a magic skill.

[0347]

F,ig. 91 shows a grid scrolling operation.

[0348]

The grid scrolling operation is determined by recognizing the trace of the XY coordinate information calculated in a predetermined time as a substantially straight line shape, by the straight-line-shaped scrolling operation of the medium on the surface of the projection panel. When

the information process device determines that the grid scrolling operation is performed, the information processing device performs a process corresponding to the scrolling operation, for example, a process, such as attack by the character designated by the player.

[0349]

Fig . 92 shows a grid scratching operation .

[ 0350 ]

The grid scratching operation is determined by repeatedly recognizing the traces of the XY coordinate information calculated in the predetermined time in a straight line shape, by means of a repetitive scratching operation of the medium on the projection panel in a straight line shape. When the information processing device determines that the grid scratching operation is performed, the information processing device performs the process corresponding to the grid scratching operation, for example, a process, such as cancellation of the instruction of the player.

[0351]

Fig. 93 shows a grid tilting operation.

[0352]

The grid tilting operation is determined by recognizing the variation of the inclination of the medium with respect to the vertical line of the projection panel in a predetermined time, by means of a tilting operation of the medium on the

surface of the projection panel.

[0353]

Specifically, as shown in Fig. 93D, in the image photographed by the infrared camera by inclining the medium surface with respect to the surface of the projection panel, one side (raised side) becomes dark, and the other (side close to the surface of the panel) becomes bright. As such, by the brightness or the darkness of the photographed image, the information processing device can determine that the grid tilting operation is performed.

[0354]

Fig. 94 shows a grid turnover operation.

[0355]

The grid turnover operation refers to an operation of turning over a portion of the surface of the medium on the surface of the projection panel. Specifically, the information processing device can determine the grid turnover operation by recognizing the area ratio of the medium surface turned over from the surface of the projection panel in a predetermined time (see Fig. 94B) .

[0356]

At this time, when the card such as the trump is used as the medium, as shown in Fig. 94C, the image of the portion turned over from the surface of the projection panel (a kind and a numeral of the card printed at the corners of the trump)

is displayed in a region of the projection panel surface where the medium surface is turned over, and it is possible to raise the display stage effect on the surface of the projection panel accompanied by the card operation by the player.

[0357]

Further, the information processing unit detects operations of the medium on the surface of the projection panel, that is, a grid tapping operation, a grid twist operation, a grid sliding operation, a grid scrolling operation, a grid scratching operation, a grid tilting operation, a grid turnover operation, and the like, and it is possible to vary the multimedia information, such as characters, diagrams, images, moving pictures, and the like, displayed on the surface of the projection panel in accordance with these operations. A variety of stage effects can be achieved.

[0358]

As such, a grid tapping operation, a grid twist operation, a grid sliding operation, a grid scrolling operation, a grid scratching operation, a grid tilting operation, a grid turnover operation, and the like are repeatedly performed, and the multimedia information, such as characters, diagrams, images, moving pictures, and the like, displayed on the surface of the projection panel is varied depending on the number of times of the operations or the speed of the operations. As a result, it is possible to further raise a stage effect with

respect to the player.

[0359]

In addition, an operation history of the grid tapping operation, the grid twist operation, the grid sliding operation, the grid scrolling operation, the grid scratching operation, the grid tilting operation, the grid turnover operation, and the like is stored in a memory of the information processing unit or a storage unit of the hard disk device, and by the combination of these operations, the multimedia information, such as characters, diagrams, images, moving pictures, and the like, displayed on the surface of the projection panel is varied. As a result, it is possible to further raise a stage effect with respect to the player.

[0360]

The medium recognized on the stage surface may be a fingertip of an operator or a player, in addition to the above-described card. As such, when the fingertip touches on the stage surface, since the brightness of the stage surface corresponding to the touched portion varies, it can be recognized that the fingertip is touched. It will be described in Fig. 97 and Fig. 98 in detail.

[0361]

As shown in Fig. 97A , a player or an operator loads the card or touches an image projected onto the stage surface by a fingertip, and the game is performed. Fig. 97B is a diagram

illustrating a case in which the state shown in Fig. 97A is viewed from the lower side of the stage surface. Fig. 98 is similar to the case of Fig. 97.

[0362]

Fig. 97C is a method of recognizing a shape of the medium. The brightness and the darkness photographed by the infrared ray are stored in the storage region, and the region of the brightness exceeding any threshold value is set to a contacting surface with the stage surface. One contact surface is set to the region where at least one of the longitudinal side, the horizontal side, the upper side, and the lower side of the pixel exceeding the threshold value among the pixels forming the storage region is continuous.

[0363]

Specifically, as shown in Fig. 97C, a region surrounded by the thick line corresponds to the region of the pixel that exceeds the threshold value, and the shape of the medium is shown.

[0364]

Further, by the image recognized by Fig. 97C, the centroid of the medium is calculated by the recognized image, such that the operation corresponding to the coordinates of the centroid can be performed. Hereinafter, a method of calculating centroid will be described.

[0365]

First, the numerical value of an X coordinate of the pixel matrix exceeding the threshold value is calculated. The values of the X coordinates in each row are x msn s to x raen e- In addition, the numerical values of all X coordinates are added. The value that is obtained by driving the values obtained by addition by the number of the pixel matrices becomes a value of an X coordinate of centroid.

[0366]

The Y coordinate of centroid is also calculated by the same method . [ Industrial Applicability]

[ 0367 ]

The invention can be used in a card game machine, a reading device of a seal, a tag, a certificate (an identification certificate and a passport) , an exchange ticket for money, and a ticket, and the like.