Improvements relating to the Access of Image Information

The invention relates to improvements relating to the access of image information, and particularly, but not exclusively, to the access of such information by blind and visually-impaired users.

Blind or visually-impaired users of computers or other devices that conveying information using images, for example on display screens, typically rely on image reader software, such as JAWS, to read aloud the visual information provided by an image on the display screen.

Despite significant advances in these assistive technologies, and increased accessibility guidelines, current image reader applications still do not resolve all of the problems that blind and visually-impaired users experience in accessing information from images in comparison to their fully-sighted counterparts. In a user requirements questionnaire, undertaken with 30 blind and visually-impaired Internet users to investigate the main problems such users face, gaining an overview of the content of an image comprising a web page was found to pose a great challenge, due to the linear model of the page derived as a result of listening to an image reader. Blind and visually-impaired users additionally wanted to attain a similar perceptual experience to that of a fully-sighted user with the aim of enabling collaborative work. Improvements in accessing image information are therefore desirable.

According to a first aspect of the invention there is provided a computer program product, comprising a receive module which receives an information image, an overlay module which overlays a grid image on the information image,

an analysis module which analyses the information image to determine the content thereof, a read module which reads the position of a marker positioned relative to the grid image and the information image, and an output module which outputs positional information comprising the position of the marker with respect to the grid image and the information image and content information comprising the content of the information image at or near the position of the marker.

The receive module may receive an information image generated by a computer. The information image may be generated using an operating system, and may comprise a desk-top image. The information image may be generated using a web browser, and may comprise a web page. The information image may comprise an image intended to be displayed on a display screen associated with the computer.

The overlay module may overlay the grid image on a desired portion of the information image. The overlay module may overlay the grid image on substantially all of the information image. The overlay module may overlay the grid image on an information image comprising a web page such that the grid image substantially fills an internal frame of web page.

The grid image may comprise a plurality of cells. Each cell may be approximately rectangular in shape. It will be appreciated, however that other cell shapes may be used. The cells may be of approximately similar size. The plurality of cells may be arranged in an array of rows and columns. For example, the array may comprise three rows and three columns each comprising three cells. The plurality of cells may be arranged in a row. For example, the row may comprise three or more cells. The row may overlay a desired portion of the information image, for

example substantially all of the width of the information image. The position of the row on the information image may be variable, for example may be movable upwards and/or downwards. The plurality of cells may be arranged in a column. For example, the column may comprise three or more cells. The column may overlay a desired portion of the information image, for example substantially all of the height of the information image. The position of the column on the information image may be variable, for example may be movable right and/or left.

The overlay module may configure the size of each cell of the grid image, to allow the grid image to overlay a desired portion of the information image. This will allow the grid image to be scaled, for example to accommodate different sizes or resolutions of different information images.

The computer program product may comprise a sizing module which selects a cell of the grid image, and instructs the overlay module to overlay a new grid image on the portion of the information image covered by the cell. This allows a user to explore the portion of the information in more detail.

The analysis module may analyse the information image by parsing the information image. The analysis module may comprise a web plug in, and may analyse an information image comprising a web page. The analysis module may analyse the information image to determine the content of a portion of the information image corresponding to each cell of the grid image. The analysis module may analyse each portion of the information image to identify one or more elements contained therein. The analysis module may analyse each portion of the information image to calculate the complexity of the content thereof. The complexity of the content of each portion of the information image may be calculated using a number of

HTML elements, a number of pictures with alt text vs a number of pictures without alt text, and a hyperlink density within the portion of the information image. The analysis module may use an algorithm to determine a content complexity weighting for each portion of the information image.

The computer program product may comprise a display module which causes the information image and the overlying grid image to be displayed together by a display screen. The grid image may be visible on top of the information image. In some applications of the invention, for example, use by blind users, display of the information image and the overlying grid image may not be necessary.

The computer program product may comprise an indication module which causes an indication to be given to a user that the information image has been overlaid with the grid image, and that the images are ready to be accessed.

The read module may read the position of the marker positioned relative to the grid image and the information image by receiving x and y location co- ordinates of the marker. The co-ordinates may be generated by a marker device used to position the marker. The marker may be a cursor and the marker device may be an input/output device.

The output module may collate information on the position of the marker and information on the content of the information image.

The output module may output the positional information and the content information to a storage device. The output module may output the positional information and the content information to one or more communication devices. At least one communication device may output

the positional information and the content information to a user of the computer program product. At least one communication device may output the positional information and the content information via one or more non-visual communications.

At least one communication device may comprise an audio output device which may output the positional information and content information via at least one of; non-speech audio communications; speech audio communications.

The non-speech audio communications may comprise a plurality of notes. The positional information may be output via the pitch of the notes. When the grid image comprises a plurality of cells, the positional information may comprise an identification of a cell in which the marker is positioned, and this may be output via the pitch of one or more notes assigned to the cell. When the grid image comprises an array of cells, for each row of the array, a first note may be assigned to a first cell, a second note may be assigned to a second cell, and so on for all of the cells in a row, and the notes may differ in pitch by a first measure for example a step comprising a major or minor second, and for each column of the array, a first note may be assigned to a first cell and a second note may be assigned to a second cell, and so on for all of the cells in a column, and the notes may differ in pitch by a second measure for example a triad comprising a major or minor third. When the grid image comprises an array of cells, first and second notes may be assigned to each cell, which first and second notes have a different pitch combination for each cell. When the grid image comprises a row of cells, a first note may be assigned to a first cell of the row, a second note may be assigned to a second cell of the row, and so on for all of the cells in the row, and the notes may differ in pitch by a measure for example a step comprising a major or minor second. When

the grid image comprises a column of cells, a first note may be assigned to a first cell of the column, a second note may be assigned to a second cell of the column, and so on for all of the cells in the column, and the notes may differ in pitch by a measure for example a triad comprising a major or minor third.

The positional information may be output via the timbre of the notes. When the grid image comprises a plurality of cells, the positional information may comprise an identification of the position of a cell in which the marker is positioned relative to the grid image, and this may be output via the timbre of one or more notes assigned to the cell. When the grid image comprises an array of cells, a first timbre may be assigned to the cells on the right side of the grid image and a second, different, timbre may be assigned to the cells on the left side of the grid image.

The content information may be output via the timbre of the notes. When the grid image comprises a plurality of cells, the content information may comprise a content complexity weighting calculated for each cell, and this may be output via the timbre of one or more notes. The greater the content complexity weighting of a cell, the "heavier" the resulting timbre output to the user may be.

The speech audio communications may comprise a plurality of messages. The positional information may be output via the messages. When the grid image comprises a plurality of cells, the positional information may comprise an identification of a cell in which the marker is positioned, and this may be output via the messages. The identification of the cell in which the marker is positioned may be given in the context of the location of the cell in the grid image as a whole, and this may be output to the user via the messages for example "top left", "bottom right" or "middle right".

The content information may be output via the messages. The content information may comprise identification of an area of significant content of the information image, such as a hyperlink, at or near the position of the marker, and this may be output to the user via the messages.

At least one communication device may comprise a mouse which may output the positional information and/or content information via haptic communications.

The haptic communications may comprise a plurality of sensations. The positional information may be output via the form of the sensations. The content information may be output via the form of the sensations.

When the grid image comprises a plurality of cells, the haptic communications may comprise an enclosure effect. The enclosure effect may use cursor clipping effects to produce the illusion of stiff walls around one or more cells, which need to be mounted by the marker in order to gently descend into the interior of the cell. When the grid image comprises a plurality of cells, the haptic communications may comprise a textual effect, which provides information on the position of the marker within a cell.

According to a second aspect of the invention there is provided a method of accessing information from an information image, comprising receiving the information image, overlaying a grid image on the information image, analysing the information image to determine the content thereof, reading the position of a marker positioned relative to the grid image and the information image, and

outputting positional information comprising the position of the marker with respect to the grid image and the information image and content information comprising the content of the information image at or near the position of the marker.

The information image may be generated by a computer. The information image may be generated using an operating system, and may comprise a desk-top image. The information image may be generated using a web browser, and may comprise a web page. The information image may comprise an image intended to be displayed on a display screen associated with the computer.

Overlaying the grid image on the information image may comprise overlaying the grid image on a desired portion of the information image, for example substantially all of the information image.

The grid image may comprise a plurality of cells. Each cell may be approximately rectangular in shape. It will be appreciated, however that other cell shapes may be used. The cells may be of approximately similar size. The plurality of cells may be arranged in an array of rows and columns. For example, the array may comprise three rows and three columns each comprising three cells. The plurality of cells may be arranged in a row. For example, the row may comprise three or more cells. The row may overlay a desired portion of the information image, for example substantially all of the width of the information image. The position of the row on the information image may be variable, for example may be movable upwards and/or downwards. The plurality of cells may be arranged in a column. For example, the column may comprise three or more cells. The column may overlay a desired portion of the information image, for example substantially all of the height of the information image.

The position of the column on the information image may be variable, for example may be movable right and/or left.

Overlaying the grid image on the information image may comprise configuring the size of each cell of the grid image, to allow the grid image to overlay a desired portion of the information image. This will allow the grid image to be scaled, for example to accommodate different sizes or resolutions of different information images.

The method may comprise selecting a cell of the grid image, and instructing the overlay module to overlay a new grid image on the portion of the information image covered by the cell. This allows a user to explore the portion of the information in more detail.

Analysing the information image may comprise parsing the information image. Analysing the information image may comprise determining the content of a portion of the information image corresponding to each cell of the grid image. Analysing the information image may comprise analysing each portion of the information image to identify one or more elements contained therein. Analysing each portion of the information image may comprise calculating the complexity of the content thereof. The complexity of the content of each portion of the information image may be calculated using a number of HTML elements, a number of pictures with alt text vs a number of pictures without alt text, and a hyperlink density within the portion of the information image. Analysing each portion of the information image may comprise using an algorithm to determine a content complexity weighting for each portion of the information image.

The method may comprise causing display of the information image and the overlying grid image together by a display screen. The grid image

may be visible on top of the information image. In some applications of the invention, for example, use by blind users, display of the information image and the overlying grid image may not be necessary.

The method may comprise causing an indication to be given to a user that the information image has been overlaid with the grid image, and that the images are ready to be accessed.

Reading the position of the marker positioned relative to the grid image and the information image may comprise receiving x and y location coordinates of the marker. The co-ordinates may be generated by a marker device used to position the marker. The marker may be a cursor and the marker device may be a mouse.

The method may comprise collating information on the position of the marker and information on the content of the information image.

The positional information and/or the content information may be output to a storage device. The positional information and/or the content information may be output to one or more communication devices. At least one communication device may output the positional information and/or the content information to a user of the method. At least one communication device may output the positional information and/or the content information via one or more non-visual communications.

At least one communication device may comprise an audio output device which may output the positional information and/or content information via non-speech and/or speech audio communications.

The non-speech audio communications may comprise a plurality of notes. The positional information may be output via the pitch of the notes. When the grid image comprises a plurality of cells, the positional information may comprise an identification of a cell in which the marker is positioned, and this may be output via the pitch of one or more notes assigned to the cell. When the grid image comprises an array of cells, for each row of the array, a first note may be assigned to a first cell, a second note may be assigned to a second cell, and so on for all of the cells in a row, and the notes may differ in pitch by a first measure for example a step comprising a major or minor second, and for each column of the array, a first note may be assigned to a first cell and a second note may be assigned to a second cell, and so on for all of the cells in a column, and the notes may differ in pitch by a second measure for example a triad comprising a major or minor third. When the grid image comprises an array of cells, first and second notes may be assigned to each cell, which first and second notes have a different pitch combination for each cell. When the grid image comprises a row of cells, a first note may be assigned to a first cell of the row, a second note may be assigned to a second cell of the row, and so on for all of the cells in the row, and the notes may differ in pitch by a measure for example a step comprising a major or minor second. When the grid image comprises a column of cells, a first note may be assigned to a first cell of the column, a second note may be assigned to a second cell of the column, and so on for all of the cells in the column, and the notes may differ in pitch by a measure for example a triad comprising a major or minor third.

The positional information may be output via the timbre of the notes. When the grid image comprises a plurality of cells, the positional information may comprise an identification of the position of a cell in which the marker is positioned relative to the grid image, and this may be output

via the timbre of one or more notes assigned to the cell. When the grid image comprises an array of cells, a first timbre may be assigned to the cells on the right side of the grid image and a second, different, timbre may be assigned to the cells on the left side of the grid image.

The content information may be output via the timbre of the notes. When the grid image comprises a plurality of cells, the content information may comprise a content complexity weighting calculated for each cell, and this may be output via the timbre of one or more notes. The greater the content complexity weighting of a cell, the "heavier" the resulting timbre output to the user may be.

The speech audio communications may comprise a plurality of messages. The positional information may be output via the messages. When the grid image comprises a plurality of cells, the positional information may comprise an identification of a cell in which the marker is positioned, and this may be output via the messages. The identification of the cell in which the marker is positioned may be given in the context of the location of the cell in the grid image as a whole, and this may be output to the user via the messages for example "top left", "bottom right" or "middle right".

The content information may be output via the messages. The content information may comprise identification of an area of significant content of the information image, such as a hyperlink, at or near the position of the marker, and this may be output to the user via the messages.

At least one communication device may comprise an input/output device which may output the positional information and/or content information via haptic communications.

The haptic communications may comprise a plurality of sensations. The positional information may be output via the form of the sensations. The content information may be output via the form of the sensations.

When the grid image comprises a plurality of cells, the haptic communications may comprise an enclosure effect. The enclosure effect may use cursor clipping effects to produce the illusion of stiff walls around at least one cell, which need to be mounted by the marker in order to gently descend into the interior of the cell. When the grid image comprises a plurality of cells, the haptic communications may comprise a textual effect, which provides information on the position of the marker within a cell.

The reading and outputting steps of the method may be repeated one or more times. For example, having positioned the marker relative to the grid image and therefore the information image, and received the positional and content information, a user may then move the marker to a new position relative to the images. The method may read the new position of the marker, and collate and output positional information of the marker and content information of the information image at or near the new position of the marker. This process may be repeated. As the user moves the cursor relative to the images, the corresponding positional and content information of the information image is conveyed to the user. The user is given continuous non visual, multimodal communication as they move the cursor around the images. The method therefore gives the user a sense of navigation in relation to an image, increasing the user's positional awareness, and allowing the user to spatially explore the image. The method further provides the user with awareness of the content of the information image, and enables the user to gain an overview of the content of the image.

According to a third aspect of the invention there is provided a method of accessing information from an information image carried out by the computer program product of the first aspect of the invention.

According to a fourth aspect of the invention there is provided a computer readable device having stored thereon the computer program product of the first aspect of the invention.

According to a fifth aspect of the invention there is provided a system for accessing information from an information image comprising a processor on which the computer program product of the first aspect of the invention is run, a marker device for positioning a marker relative to the information image and at least one communication device.

The system may further comprise a display screen. The system may further comprise a keyboard.

Embodiments of the invention will now be described by way of example only, with reference to the accompanying drawings, in which :

Figure 1 is a schematic representation of a system for accessing image information according to the fifth aspect of the invention, in which a computer program product according to the first aspect of the invention is used;

Figure 2 is a representation of an information image overlaid with a grid image comprising an array of cells;

Figure 3 is a representation of an information image overlaid with a grid image comprising a row of cells;

Figure 4 shows a schematic representation of a first embodiment of pitches of notes assigned to the cells of the grid image of Figure 2, and

Figure 5 shows a schematic representation of a second embodiment of pitches of notes assigned to the cells of the grid image of Figure 2.

Figure 1 shows a schematic representation of a system for accessing image information according to the invention, comprising a computer system 1 in which the computer program product of the invention is used. The computer program product is intended for particular use by blind and visually-impaired users, to access information provided by images using non-visual communication means. However, the computer program product can also be used by sighted users, for example, in conjunction with blind or visually-impaired users, allowing the users to access the same information from an image. The computer system 1 comprises a processor 2, a display screen 3, a marker device comprising an input/output device in the form of a mouse 4, a keyboard 5 and a communication device comprising an audio output device 6. (Although the system described here is referred to as a computer system, it will be appreciated that the invention can comprise any system which comprises the same basic components, for example a TV monitor provided with a processor, keyboard, marker device and communication device.) The computer system 1 will generate information images. Generally, these will comprise images that are intended to be displayed by the display screen 3, i.e. display screen images. However, it will be appreciated that it may not be necessary for the display screen 3 to actually display an image. For some uses of the computer program product, e.g. by blind users alone, display of an image may not be required. The computer program product of the invention allows access to information provided by an image, whether or not this is actually displayed. The information images

may be generated as a result of computer programs being run by the processor 2, for example document processing programs or web browsers. The latter will generate information images comprising web pages, and the invention is of particular use for accessing information provided by these.

A user of the computer program product causes the product to be loaded onto and run by the processor 2 of the computer system 1. This causes the modules of the product to carry out their various functions. The user interacts with the computer program product via the mouse 4, the keyboard 5, the audio output device 6, and possibly the display screen 3.

The computer program product operates as follows. The receive module of the computer program product receives an information image. The overlay module then overlays a grid image on the information image. The grid image may have one of a number of formats. Figure 2 shows a first format, where the grid image comprises an array of rectangular cells of approximately similar size, the array comprising three rows and three columns each having three cells. The overlay module is able to configure the size of each of the cells, to allow the grid image to overlay a desired portion of the information image. In this format, the size of the cells is configured such that the grid image is overlaid on substantially all of the information image, i.e. the nine rectangular cells cover substantially all of the information image.

Figure 3 shows a second format of the grid image. This comprises nine rectangular cells of substantially similar size, arranged in a row. In this format, the overlay module has configured the size of the cells such that the grid image row overlays substantially all of the width of the information

image. The position of the row on the information image may be varied, for example, may be moved upwards or downwards.

Although not illustrated, it will be appreciated that the grid image may also take the format of a plurality of cells in a column, which overlays a desired portion of the information image, for example, substantially all of the height of the information image. As before, the position of the column of the grid image on the information image may be varied, e.g. may be moved left or right.

The analysis module then analyses the information image to determine the content of a portion of the information image corresponding to each cell of the grid image. The analysis module analyses each portion of the information image to identify one or more elements contained therein. The analysis module further calculates the complexity of the content of each portion of the information image, using a number of HTML elements, a number of pictures with alt text versus a number of pictures without alt text, and a hyperlink density within the portion of the information image. The analysis module then uses an algorithm to determine a content complexity weighting for each portion of the information image.

The display module may then cause the information image and the overlying grid image to be displayed together by the display screen 3, although, as previously referred to, this may not be necessary. The grid image will be visible on top of the information image.

The indication module may then cause an indication to be given to the user that the information image has been overlaid with the grid image, and that the images are ready to be accessed. The user then uses the mouse 4 to cause a marker to take up a position relative to the grid image and the

information image. When the information image and the grid image are being displayed by the display screen, this will comprise operating the mouse 4 so that the marker comprising a cursor points to a position on the display screen 3, i.e. to a position on the grid image and therefore the information image. The read module of the computer program product then reads the position of the cursor, by receiving x and y location coordinates of the cursor from the processor 2.

The output module of the computer program product then collates the information on the position of the cursor and information on the content of the information image, and outputs positional information comprising the position of the cursor relative to the grid image and the information image and content information comprising the content of the information image at or near the position of the cursor. The positional information and the content information are output to one or more communication devices, which, in turn, output the information to the user via non-visual communications. (It will be appreciated that the positional and/or content information could be output to a storage means, for, for example, subsequent access by the user.) In this embodiment, two communication devices are used, the audio output device 6 which outputs non-speech and speech audio communications, and the mouse 4 which outputs haptic communications. It will be appreciated that more or less communication devices can be used. The audio output device 6 outputs the non-speech and speech audio communications using a real-time audio programming environment. The mouse 4 comprises a force-feedback mouse, which provides a variety of haptic sensations generated by the electrical motors contained within the mouse base. This type of mouse is particularly useful when information images comprising web pages are to be accessed, as it is compatible with, for example, a Firefox web browser.

The non-speech audio communications comprise a plurality of notes. One or more notes of different pitches are assigned to each cell of the grid image, by placing the notes in different spatial positions corresponding to the cells using a HRTF. The spatial positions of the notes of a row of cells of the grid image are mapped to azimuth values between 0 and 180 degrees of the HRTF, and the spatial positions of the notes of a column of cells of the grid image are mapped to elevation values between 0 and 90 degrees.

The positional information comprises an identification of the cell in which the cursor is positioned, and this is output to the user via the pitch of the one or more notes assigned to the cell, output to the user via the audio output device 6. When the grid image comprises an array of cells, as in Figure 2, two implementations of conveying information by pitch can be used. In the first implementation, for each of the rows of the array, a first note is assigned to a first cell, a second note is assigned to a second cell, and so on for all of the cells in a row, and the notes differ in pitch by a step comprising a major or minor second. In the first implementation, for each of the columns of the array, a first note is assigned to a first cell and a second note is assigned to a second, and so on for all of the cells in a column, and the notes differ in pitch by a triad comprising a major or minor third. In the second implementation, first and second notes are assigned to each cell, which first and second notes have a different pitch combination for each cell.

When the grid image comprises a row of cells, as in Figure 3, the positional information again comprises an identification of the cell in which the cursor is positioned, and this is conveyed to the user by the pitch of a note assigned to the cell, output to the user via the audio output device 6. A first note is assigned to a first cell of the row, a second note is assigned

to a second cell of the row, and so on for all of the cells in the row, and the notes differ in pitch by a step comprising a major or minor second.

The positional information can also be output to the user via the timbre of the note or notes assigned to the cells of the grid image. The timbre of the note or notes assigned to the cells in the array of Figure 2 or the row of Figure 3, are designed to be different according to the spatial position of the cell in the grid image. For example a first timbre is associated with the cells on the right side of the grid image and a second, different, timbre is associated with the cells on the left side of the grid image. Movement of the cursor is mapped to a controlled morph between the two timbres, so that the user can perceive the spatial movement of the cursor through timbre.

The content information of the information image at or near the position of the cursor in a cell of the grid image, is also output to the user via the timbre of the note or notes assigned to each cell. When the cursor is placed in a cell, the complexity weighting calculated for the cell is sonified and output by the audio output device 6. The greater the complexity weighting of a cell, the "heavier" the resulting timbre output to the user.

This sonic complexity weighting of the cells is used in rows and/or columns of the grid images as appropriate, and the user can form an overview of the content of the information image through the timbre of the note(s) of the cells of the grid image overlaid thereon.

The output module can also cause the audio output device 6 to output speech audio communications in addition to or as an alternative non- speech audio feedback. An additional plug-in utilizing the Microsoft Speech SDK was developed and integrated with the computer program product to provide the speech audio communications. The speech audio

communications comprise a plurality of messages, and the positional information is output to the user via the content of the messages. The positional information comprises an identification of the cell in which the cursor is positioned, and this is output to the user via the content of the messages. The messages may comprise the identification of the cell in the context of its position in the grid image as a whole, for example "top left", "bottom right" or middle right". Such speech audio communications enable the user to orientate himself on the information image. The content information is also output to the user via the content of the messages. The content information may comprise identification of an area of significant content, such as a hyperlink, of the information image at or near the position of the cursor, and this is output to the user via the content of the messages.

The output module of the computer program product further outputs the positional and content information by causing the mouse 4 to output haptic communications. The haptic communications comprise a plurality of sensations. The positional information is output to the user via the form of the sensations. A variety of sensations are generated by the mouse 4, depending on the position of the cursor on the grid image. The output module causes the mouse 4 to generate a haptic communication comprising an enclosure effect, which allows the user to perceive the walls of each cell of the grid image. Cursor clipping effects are used to produce the illusion of stiff walls around each cell, which need to be mounted in order to gently descend into the interior of the cell. Once the cursor has been moved into the interior of the cell, it is constrained within the walls thereof. Applying a small amount of force to the cursor will cause it to mount a wall of a cell, and move to the neighbouring cell. The output module also causes the mouse 4 to generate a haptic communication comprising a textual effect, which allows the user to explore the interior of

a cell. The textural effect in a cell provides information on the position of the cursor within the cell. Haptic frames are also provided, which allow the user to maintain a sense of distance travelled, scale and direction whilst navigating a cell of the grid image.

The user may use the sizing module of the computer program product to adjust the size of the information image, for example to magnify or de- magnify the image. This allows the user to zoom into and out of any area of the information image. The sizing module may magnify the information image such that a portion of the information image corresponding to a cell of the overlaid grid image is magnified to fill substantially all of the previous size of the information image. The overlay module then overlays a new grid image on the magnified portion of the information image. As above, the cursor can be positioned relative to the new grid image, and positional and content information output to the user.

It can be seen that, by overlaying a grid image on the information image, when the cursor is positioned relative to the grid image, and therefore the information image, the user is provided with information on the position of the cursor relative to the images, and is therefore able to quickly assess where they are on the images, and is also provided with information on the content of the information image. The non-visual, multimodal communications used to communicate the positional and content information to the user, particularly allows blind or visually-impaired users to access information from the image. Use of the overlay grid also allows blind or visually-impaired users and sighted users to more easily communicate regarding the content of the information image at various locations thereof.

Having positioned the cursor relative to the grid image and therefore the information image, and received the positional and content information, the user may then move the cursor to a new position relative to the images. The computer program product will read the new position of the cursor, and collate and output positional information of the cursor and content information of the information image at or near the new position of the cursor. As the user moves the cursor relative to the images, the computer program product conveys the corresponding positional and content information of the information image to the user. The user is given continuous non visual, multimodal communication as they move the cursor around the images. The computer program product therefore gives the user a sense of navigation in relation to an image, increasing the user's positional awareness, and allowing the user to spatially explore the image. The computer program product further provides the user with awareness of the content of the information image, and enables the user to gain an overview of the content of the image. Particularly, when a grid image comprising a row is used, the user is able to gain an overview of the content of a line of the information image, and so can "scan" the image quickly from left to right, as sighted users would. The invention therefore allows the user to develop a mental model of an information image, similar to the visual depiction of an image developed by a sighted user, and different from the linear model derived as a result of listening to a screen image reader.