INTERACTIVE VISUALISATION SYSTEM AND METHOD FOR ELECTRONIC

COMMUNICATIONS ANALYSIS

FIELD OF INVENTION

The present invention relates to the field of electronic communication and in particular to a method and system of providing an interactive visualisation for electronic communications authored by individuals.

BACKGROUND OF INVENTION

The use of electronic communications is widespread. People exchange ideas and information, create communities and construct knowledge through dialogue using electronic communications. Electronic communications may be sent via tools such as e-mail, chat systems, multi-user dungeons (MUDs), computer conferencing systems, bulletin board systems, Usenet news groups and weblogs. In fact, users can send electronic communications through any tool that facilitates the exchange of electronic messages among a group of participants by means of networked computers or other electronic devices.

Usually, electronic communications are used for the purpose of discussing a topic of mutual interest. In the education sector and in many other areas it may be helpful to be able to trace the topics that are discussed and the roles that participants take in discussions. It may also be useful to be able to trace the process by which participants come to any conclusions on the topic or construct meanings during the discussion.

However, effective simultaneous tracing of these dimensions of a discussion via electronic communication can be difficult. Current message tools and discussion forum tools typically organise messages posted either chronologically (linearly) or in bundles with electronic communications related to the same topic (or conversation thread) organised together. Often the only alternative is to sort electronic communications according to the author of the message. None of these- approaches enables the accurate tracing and analysis of sequences of interactions between participants in a discussion. This type of arrangement of electronic

communications also cannot detect sub-topics or conversations emerging within topic- bundled communications.

It would be desirable to provide an interactive visualisation for a record of electronic communications that ameliorated one or more of the disadvantages of the prior art discussed above or that at least provided the public with a useful choice.

SUMMARY OF INVENTION

The invention provides a method of generating an interactive visualisation of a plurality of electronic communications. The method includes the steps of maintaining two or more of the electronic communications in computer memory; assigning a communication identifier and author identifier to each of the two or more electronic communications; generating respective participant key-codes for each of the two or more electronic communications at least partly from the communication identifier and author identifier; associating a parent identifier with at least one of the electronic communications, the parent identifier establishing a parent-child relationship between a child electronic communication and a parent electronic communication to which the child electronic communication is a direct reply; generating on a display a graphic representation of each electronic communication; generating on the display a graphic connector between respective pairs of representations of electronic communications that are in a parent-child relationship; designating as a mutual interest hub each electronic communication that is a child electronic communication in a parent-child relationship with a first electronic communication and that is a parent electronic communication in a parent-child relationship with a second electronic communication; generating on the display a graphic representation of each mutual interest hub to visually distinguish those electronic communications that are mutual interest hubs from those electronic communications that are not mutual interest hubs; and in response to input from a user, displaying on the display additional information about one or more related electronic communications.

The term "comprising" as used in this specification means "consisting at least in part of; that is to say when interpreting statements in this specification which include the term "comprising", the features prefaced by this term in each statement all need to be present but other features can also be present. Related terms such as "comprise" and "comprised" are to

be interpreted in a similar manner. The terms "including" and "included" should also be interpreted in a similar manner.

BRIEF DESCRIPTION OF THE FIGURES

Preferred forms of the invention will now be described with reference to the accompanying drawings in which:

Figure 1 illustrates an exemplary network arrangement in which the invention may be implemented;

Figure 2 illustrates an exemplary system architecture in which the invention may be implemented;

Figure 3 is a table of identifiers that may be used in conjunction with one or more of the embodiments of the invention;

Figure 4 is a table showing a binary matrix based on participant and affiliation key-codes in accordance with one or more embodiments of the invention;

Figure 5 is a table showing a binary matrix based on participant and affiliation key-codes in accordance with one or more embodiments of the invention;

Figure 6 is a table showing a binary matrix based on participant and affiliation key-codes in accordance with one or more embodiments of the invention;

Figure 7 is a simple representation of connected electronic communications that the invention is capable of generating;

Figure 8 illustrates a representation of electronic communications in accordance with one or more embodiments of the invention;

Figure 9 illustrates a representation of electronic communications in accordance with one or more embodiments of the invention;

Figure 10 illustrates a representation of electronic communications in accordance with one or more embodiments of the invention;

Figure 11 illustrates a representation of electronic communications in accordance with one or more embodiments of the invention; and

Figure 12 illustrates a representation of electronic communications in accordance with one or more embodiments of the invention.

DETAILED DESCRIPTION

The present invention is embodied in the methods herein described including the methods as implemented in any suitable computing environment. The invention is also embodied by computer software that implements the invention including computer programs comprising computer-executable instructions that, when executed in an appropriate computing system, will cause the system to perform the methods of the invention. Computer software may include computer programs, computer modules, routines, objects, components, or data structures that perform particular tasks. The invention may also be embodied in a computer- readable medium on which computer software for performing the methods of the invention is stored. The invention may also be embodied by any system that is a combination of hardware and software that is configured to perform the methods of the invention, for example by being programmed with appropriate computer-executable instructions.

Figure 1 illustrates a block diagram of a suitable network arrangement 100 in which one or more embodiments of the present invention 105 may be implemented. Network arrangement 100 is only one example of a suitable network environment and is not intended to suggest any limitation to the use or functionality of the invention.

The system 100 preferably includes one or more clients 110, for example HOA, HOB, HOC, HOD, HOE, and 11 OF which each may comprise a personal computer or workstation as described below. It will be appreciated that clients 110 may also comprise any device with sufficient processing, input, and output capabilities to provide an interface to the invention, for example, a portable computing device such as a laptop or a mobile device such as a cellphone.

Each client 110 is interfaced to the invention at 105 as shown in Figure 1. Each client could be connected directly to the invention, could be connected through a local area network or LAN, could be connected through the Internet, through a wireless network, or any combination of the above.

Clients HOA and HOB, for example, are connected to a network 120, such as a local area network or LAN. The network 120 could be connected to a suitable network server 125 and communicate with the invention as shown. Client HOC is shown connected directly to the invention 105. Clients HOD, HOE, and HOF are shown connected to the Internet 130.

Client 11OD is shown as connected to the Internet 130 with a dial-up or broadband connection and clients HOE and 11 OF are shown connected to a network 140 such as a local area network or LAN with the network 140 connected to a suitable network server 145.

It will be appreciated that a client 110 may be connected to the invention 105 directly, via a network or via the Internet 130 by any available means such as, for example, wireless or cable.

Clients may either send electronic communications to each other via the invention at 105 where a record of all communications is then stored or alternatively, one or more records of electronic communications may be present at 105 because a participant in an electronic discussion has been sending and receiving electronic communications at 105 or because one

or more records of electronic messages have been sent to the invention 105 from a client 110 or has been introduced to the invention 105 directly by a user.

One exemplary form of the invention at 105 comprises a personal computer or server 150 operating under the control of appropriate operating and application software having a data memory 160 storing local data for the invention.

Figure 2 shows an exemplary system architecture of a client 110 or server 150. System 200 is only one example of a suitable computing environment and is not intended to suggest any limitation on the use or functionality of the invention nor is it intended to suggest any dependency or requirement for any one or combination of components illustrated in Figure 2. The invention is capable of being embodied in a number of computing system environments or configurations such as, for example, hand-held systems such as personal digital assistants, mobile phones, laptop computers, microprocessor based or programmable consumer electronics, and pocket PCs. The invention may also be implemented in a distributed computing environment in which tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

The computer system 200 typically comprises one or more processors 202, a main memory 204 for example RAM, and an input/output controller 206. Exemplary system 200 also comprises non- volatile storage memory 160 in the form of one or more computer-readable media such as, for example, an internal hard drive or removable drive, floppy disk, or CD- Rom. The exemplary computer system 200 may also comprise peripherals such as a keyboard 208, a pointing device 210, for example a mouse, touchpad, or trackball, a display or screen device 212, and an output device 216 such as a printer. The system 200 could also include a network interface card or controller 218 and/or a modem 220. The individual components of the system 200 could communicate through a system bus 222.

The invention provides system and method for generating an interactive visualisation for one or more records of electronic communications on a display, for example 212, either at invention 105 or at a client 110.

In order to produce the interactive visualisation the invention organises the electronic communications in a data memory or computer memory in particular ways. In particularly preferred embodiments the communications are stored in an SQL database, for example in data memory 160, and are associated with particular SQL key-codes.

Each electronic communication is stored in relation to identifiers of particular characteristics of the communication. In particular, each electronic communication is stored in relation to an identifier of the individual communication and the author of the communication. Each electronic communication is assigned a communication identifier and an author identifier. The combination of the communication identifier and the author identifier enables the invention to clearly show not only who participated in each discussion but also where in each discussion the participant was active and what role they played in the discussion. Multiple profiles are therefore produced for each participant, one for every electronic communication that they author. The combination of at least the communication identifier and the author identifier for the author of the communication creates a participant key-code for each electronic communication.

Each electronic communication is also stored in relation to an identifier of any "parent" communication. A parent identifier is associated with at least one of the electronic communications. A parent communication is a communication to which any electronic communication is a direct reply. The identifier of any parent communication creates an affiliation key-code for each electronic communication. The parent identifier establishes a parent-child relationship between a child electronic communication and a parent electronic communication to which the child electronic communication is a direct reply.

A thread identifier may optionally be added to either or both of the participant or affiliation key-codes for each electronic communication. A content (subject line/ topic) identifier may be added to either or both of the participant or affiliation key-codes for each electronic communication

Figure 3 illustrates an example of four electronic communications or messages with example identifiers. Column 310 shows possible identifiers for the authors of the communications. In this example the identifiers are the names of the authors, but a numeric identifier or a combination of names, initials or alphanumeric identifiers could also be used. Column 320 shows a unique identifier, in this example numeric, of each individual communication. Although not shown, if any of the participants had contributed more than one electronic communication to the discussion there would be a further row entry for the author but with a different identifier for the particular electronic communication in column 320. Column 330 shows the parent identifiers for each communication. In this example Mary is not replying to anyone and so her communication 100 does not have a parent identifier but simply a null entry 0. However, Bob's 344 communication and John's 542 communication are both in reply to Mary's 100 communication so they both have 100 as their parent identifier. Diane's communication 678 is not replying to Mary's 100 communication but rather to Bob's 344 communication so Diane's 678 communication takes 344 as its parent identifier. Column 340 shows a thread identifier. In this case all communications relate to the same thread 100.

Figure 4 is a further table of the same four communications. In this table a binary matrix is produced that illustrates the relationships between the messages. In this table the participant key-codes for the messages are comprised of a combination of the author, thread, and individual communication identifiers. The affiliation key-codes are simply shown as the parent identifiers however as mentioned above the affiliation key-codes may also comprise the thread identifier.

This binary matrix illustrates how the invention is able to identify connections between messages and their authors. For example in Figure 5 at 500 all messages that can be directly related to Mary's 100 communication are circled. In Figure 6, all messages that can be

directly related to Bob's 344 communication are circled and indicated at 610. The messages circled at 500 in Figure 5 and at 610 in figure 6 can be viewed as conversations within a discussion thread.

In this type of matrix, any entry in the 0 affiliation column may be the beginning of a new thread of conversation or discussion. Any entry in the other columns indicates a point of mutual interest, referred to throughout this specification as a mutual interest hub. An electronic communication is designated as a mutual interest hub if it is a child electronic communication in a parent-child relationship with a first electronic communication as well as being a parent electronic communication in a parent-child relationship with a second electronic communication.

The use of the key-codes discussed above to organise electronic communication data enables the invention to provide an interactive visualisation of the invention that allows a user presented with the representation to identify important or interesting characteristics about the discussion including the roles that individual participants take in the discussion and that enables the clear tracing of the progress of the discussion in terms of subject matter and construction of meaning by the participants.

Figure 7 illustrates a simple representation of the connections between the messages listed in the tables of figures 3 to 6. The individual electronic communications are illustrated as grey circles in this representation but they could also be illustrated using any distinctive shape or symbol.

In this representation, box 100-0 merely indicates the beginning of the discussion thread 100. Mary's 100 electronic communication is connected to box 100-0 because it is the first communication in the discussion thread.

Both Bob's 344 communication and John's 542 communication are connected by lines to Mary's 100 communication because they each have message 100 as their parent identifier and

therefore their affiliation key-code. Although Diane's 678 communication forms part of the same discussion thread, it takes Bob's 344 communication as its parent identifier and therefore it is connected to the representation of Bob's 344 communication rather than any of the other communications.

For these messages the invention is able to identify Mary's 100 communication and Bob's 344 communication as mutual interest hubs. Mutual interest hubs are therefore rendered on the representation as illustrated in Figure 8. In this example the mutual interest hubs are illustrated as black hourglass shapes superimposed over the representations of individual electronic communications. As with the representations of individual messages, the mutual interest hubs could be represented by any distinctive symbol or shape without departing from the scope of the present invention.

The graphic representation of the mutual interest hubs are selected so as to visually distinguish those electronic communications that are mutual interest hubs from those electronic communications that are not mutual interest hubs.

Figure 9 illustrates a representation of a more complex discussion thread, in this case a thread identified as 13934. This example provides a clear illustration of how one participant may have multiple profiles within a discussion when they author more than one message. For example, participant Elaine authored four different electronic communications within the discussion and therefore appears four different times in the representation of the discussion.

This example also illustrates how the representation produced by the invention may also enable a user to identify the roles that individual participants have at different places in the conversation. For example, in Figure 10 the circled portion of the representation of the discussion shows a wide range of interest in Debbie's initial 13934 communication. Debbie therefore takes on a central role at this point in the discussion.

In Figure 11, the circled portion of the representation of the discussion shows a less centralised dialogue style of discussion in which Elaine and Debbie reply to each other's electronic communications. This dialogue style of discussion creates a chain effect in the representation of the discussion.

In Figure 12, the circled portion of the representation of the discussion shows Elaine's 14025 electronic communication splitting the interest of the participants so that the discussion proceeds in two sub-threads or chains. This type of communication at which an original discussion thread splits into two or more new threads or sub-threads is referred to as a pivot point.

In particularly preferred embodiments of the invention the chronological sequence in which electronic communications are received is not a relevant factor in producing the representation of a discussion thread. This means that the representation will accurately trace the actual sequence of interconnected messages (in terms of subject matter and responses to other messages) even though the asynchronous nature of many types of electronic communication would usually result in a response being separated from its parent communication when the communications that make up a discussion are viewed in a temporal sequence.

However, the representation is also an interactive visualisation that provides access to additional data about the electronic communications that make up the discussion thread. In this context, placing a pointing device like a mouse cursor over the representation of a particular communication may result in additional information about the electronic communication being displayed to the user on or beside the representation of the discussion. Such details may include, for example, the time and date on which the electronic communication was authored and or sent/posted, the size of the communication, any attachments to the communication, the subject of the communication as nominated by the author, and the content such as the full text of the electronic communication.

The interactive visualisation provided by the representation will allow users to select mutual interest hubs, for example by clicking on the representation of a mutual interest hub with a mouse, in order to find out more about messages that are related to that mutual interest hub. Different options may enable a user to review different types of information at a mutual interest hub. For example, clicking on the mutual interest hub at Elaine 14025 in Figure 9 may provide a user with the option to select one of the two sub-threads that extend from that communication or alternatively the invention may display the messages for both sub-threads in separate display spaces or windows.

Options provided for the interactive visualisation may also allow a user to specify whether they would like to review communications immediately prior to the mutual interest hub in the discussion thread. For example at Elaine 14025, the user may have the option to review messages back to Debbie 14001 or even Debbie 13934 as well as communications from one or both of the sub-threads that extend from Elaine 14025 and the text of Elaine 14025 itself.

Other options may enable the user to specify whether they would only like to review the next x number of communications in any thread or to review all communications up to the next pivot point (or beyond).

The invention may also enable users to quickly identify the level of participation by one or more participants of the discussion. This may be achieved for example by allowing the user to select a user identifier from a menu or directly from the representation and then highlighting the representation of all electronic communications that were authored by that user. All of the highlighted communications share the selected author identifier.

The invention may also produce reports on the levels of participation by participants in terms of the number of communications contributed. More active or significant participation may be gauged by counting the number of communications that take electronic communications authored by a particular participant as their parent/affiliation key-code. Alternatively, such a

report may be produced by tallying up the number of communications authored by a particular participant that are also mutual interest hubs.

The invention may also produce reports on the most popular discussion threads on a system or the most popular sub-threads within a discussion thread. Popular sub-threads may be identified by the number of messages in a message chain between pivot points or the number of communications connected in any way to a particular mutual interest hub.

One embodiment of the invention provides one or more of the following analytic features: (a) Colour coding use of shapes and line thicknesses to distinguish electronic messages and identifying the significance and weighting of the relationships between them;

(b) Analysis of the centrality of participants - this is a Social Network Analysis mathematic calculation of the centrality of a member in an electronic conversation. Centrality measures provides information about amount of information controlled by a member;

(c) Identifying and providing real time illustration of the dynamics of a conversation;

(d) Identifying, co-membership in hubs - comprising a member's profile of interests; and/or

(e) Identifying connectors or stoppers of the creation of the social network.

The invention may be implemented as part of an e-mail program or other social networking electronic communication tool or application so that users of the tool may be able to generate representations of electronic discussions that they have participated in and more easily locate a communication or a portion of the discussion that they are interested in reviewing again.

The foregoing describes the invention including preferred forms thereof. Modifications and improvements as would be obvious to those skilled in the art are intended to be incorporated in the scope hereof, as defined by the accompanying claims.