Copyright Notice:

[0001] A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever. Field of Invention:

[0002] The present invention is generally related to computer systems, and is particularly related to a middleware machine environment.

Background:

[0003] The interconnection network plays a beneficial role in the next generation of super computers, clusters, and data centers. For example, the InfiniBand (IB) technology has seen increased deployment as the foundation for a cloud computing fabric. As larger cloud computing architectures are introduced, the performance and administrative bottlenecks associated with the traditional network and storage have become a significant problem.

[0004] This is the general area that embodiments of the invention are intended to address.

Summary:

[0005] Described herein is a system and method that can ensure Internet Protocol (IP) address and node name consistency when performing remote transactions via multiple un-related IP addresses for the same remote peer. The system can ensure that all cooperating peer nodes are in full agreement of the names and IP addresses at any point in time. In particular, when network configurations can be updated dynamically, the system can ensure that such updates do not lead to inconsistent or failed transactions because a peer node has a stale view of what addresses to use. Furthermore, the peer node that initiates the transaction can verify that all the other peer nodes have exactly the same view of the overall system configuration, in order to ensure that each distributed transaction is carried out using consistent address information.

Brief Description of the Figures:

[0006] Figure 1 shows an illustration of supporting distributed transactions using highly available communication in a middleware machine environment, in accordance with an embodiment of the invention.

[0007] Figure 2 shows an illustration of ensuring consistent address information for supporting distributed transactions in a middleware machine environment, in accordance with an embodiment of the invention.

[0008] Figure 3 shows an illustration of supporting distributed transactions when network configuration changes in a middleware machine environment, in accordance with an embodiment of the invention.

[0009] Figure 4 illustrates an exemplary flow chart for ensuring consistent address information for supporting distributed transaction in a middleware machine environment, in accordance with an embodiment of the invention.

[00010] Figure 5 illustrates an exemplary function block diagram for ensuring consistent address information for supporting distributed transactions in a middleware machine environment, in accordance with an embodiment of the invention.

[00011] Figure 6 shows a peer node in accordance with an embodiment of the present invention.

Detailed Description:

[00012] The invention is illustrated, by way of example and not by way of limitation, in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to "an" or "one" or "some" embodiment(s) in this disclosure are not necessarily to the same embodiment, and such references mean at least one.

[00013] The description of the invention as following uses the Internet Protocol (IP) network as an example for a computer network. It will be apparent to those skilled in the art that other types of computer networks can be used without limitation.

[00014] Described herein is a system and method that can ensure system configuration consistency, such as IP address and node name consistency, in a middleware machine environment.

[00015] Figure 1 shows an illustration of supporting distributed transactions using highly available communication in a middleware machine environment, in accordance with an embodiment of the invention. As shown in Figure 1 , a middleware machine environment 100 can include one or more peer nodes A-D 101 -104 that are interconnected via different subnets, e.g. subnets A-C 1 1 1 - 1 13. Each peer node A-D 101-104 can be associated with different IP addresses, e.g. IP addresses 121-124, and various network interfaces, e.g. network interfaces 131-134.

[00016] In accordance with an embodiment of the invention, various distributed transactions can be performed, or implemented, in the middleware machine environment 100, using highly available communication via multiple networks (or subnets) via multiple local network interfaces and multiple independent local and remote IP addresses.

[00017] Furthermore, all cooperating peer nodes A-D 101-104 can be in full agreement about the names and IP addresses that are relevant for each such peer at any point in time. Additionally, when network configurations, e.g. network configuration 1 10, is updated dynamically, it is beneficial to ensure that such updates do not lead to inconsistent or failed transactions because some peer has a stale view of what addresses to use.

[00018] Figure 2 shows an illustration of ensuring consistent address information for supporting distributed transactions in a middleware machine environment, in accordance with an embodiment of the invention. As shown in Figure 2, a peer node A 201 can initiate a distributed transaction 210 with one or more remote peer nodes, e.g. a peer node B 202, in a middleware machine environment 200. Here, the peer node A 201 is associated with network addresses 21 1-212, and the peer node 202 is associated with network addresses 221-223.

[00019] In order to ensure that the distributed transaction 210 can be carried out using consistent address information, the peer node A 201 can verify that all the other peer nodes, such as the peer node B 202, have exactly the same view of the total system configuration 220 as itself.

[00020] In accordance with an embodiment of the invention, the information to be checked by the peer node A 201 , which initiates the distributed transaction 210, can include one or more unique names associated with each peer node, a list of networks, and the IP addresses that each peer node is supposed to be reached via for each individual network.

[00021] Furthermore, each remote peer node (e.g. the peer node B 202) can ensure that information about itself is consistent with the local OS/networking configuration 230 before responding. Thus, the system can be assured that no administrator error can prevent consistent execution of distributed transactions.

[00022] Figure 3 shows an illustration of supporting distributed transactions when network configuration changes in a middleware machine environment, in accordance with an embodiment of the invention. As shown in Figure 3, a distributed transaction can be performed in a middleware machine environment 300, involving peer nodes A-C 301 -303. Here, the peer node A 301 can be associated with a network address 31 1 , while the peer node B 302 can be associated with network addresses 321 -322 and the peer node C 303 can be associated with network addresses 331 -333.

[00023] In accordance with an embodiment of the invention, when a change in the networking configuration 320 happens, the system can bring all cooperating peer nodes A-C 301-303 in synchronization, before any subsequent distributed transactions can be carried out. Additionally, the update of the networking configuration 320 can be either automatic or manual as long as the required consistency can be achieved.

[00024] Furthermore, for a fixed set of cooperating peer nodes A-C 301 -303 with potential changes in networking address information, the robust consistency check carried out by the system as part of each distributed transaction can be sufficient to ensure that no distributed transaction can be successfully initiated during a period when the network configuration is not consistent among all cooperating peer nodes A-C 301-303.

[00025] Also, there can be situations when the set of cooperating nodes A-C 301 -303 may not be in synchronization in terms of the list of member nodes itself. The robust consistency checks can ensure that each cooperating node A-C 301 -303 can have the same view of what the total set of nodes are, in addition to which addresses are associated with each node. For example, the system can detect a change (or inconsistency) in the network configuration 320 using the above scheme, if the list of cooperating peer nodes is to be changed.

[00026] In accordance with an embodiment of the invention, a change (or inconsistency) in the network configuration 320 can be detected synchronously, and the overall configuration information can be checked and updated as appropriate in order to allow the subsequent transactions to take place.

[00027] As shown in Figure 3, a network address 331 can be dynamically changed during the execution of a distributed transaction. This change (or inconsistency) in the network configuration 320 may happen after the relevant address is no longer in use (or the relevant address is never used at all) during the distributed transaction. In these cases, the change (or inconsistency) in the network configuration 320 may not cause any issue for performing the transaction.

[00028] Additionally, the change in the network configuration 320 may happen while the address is still being used or before it is used. In such cases, the issue may either be detected by an address probe operation, via an explicit check operation as part of a remote operation, or be handled as a communication failure (e.g. TCP timeout) during the actual communication.

[00029] Figure 4 illustrates an exemplary flow chart for ensuring consistent address information for supporting distributed transactions in a middleware machine environment, in accordance with an embodiment of the invention. As shown in Figure 4, at step 401 , a peer node can initiate one or more distributed transactions with one or more remote peer nodes, each of which can be associated with multiple network addresses. Then, at step 402, the peer node can verify that each remote peer node has a same view of system configuration. Furthermore, at step 403, the system can execute the distributed transactions via the multiple network addresses associated with the remote peer node

[00030] Figure 5 illustrates an exemplary functional block diagram for ensuring consistent address information for supporting distributed transactions in a middleware machine environment, in accordance with an embodiment of the invention. As shown in Figure 5, each peer node includes a network manager 501 , a network interface 502, a transaction executing module 503, and a verifying module 504. The network manager 501 manages a system configuration which is related to all cooperating peer nodes and includes one or more unique names, a list of networks and internet protocol (IP) addresses. The network interface 502 acts as a physical layer for transmitting and receiving signals to and from one or more remote peer nodes.

[00031] In response to any explicit or implicit event, the transaction executing module 503 initiates a distributed transaction with one or more remote peer nodes. Each distributed transaction is associated with the multiple network addresses. The verifying module 504 verifies that the one or more remote peer nodes all have the same view of the system configuration. As an exemplary implementation, the verifying module 504 obtains a system configuration from the network manager 501 in its own peer node and obtains system configuration(s) from the one or more remote peer nodes, and then compare them to each other to ensure consistent address information.

[00032] Once the transaction executing module 503 receives a successful result of verification from the verifying module 504, the transaction executing module 503 begins to execute the distributed transaction via the multiple network addresses associated with the one or more remote peer nodes.

[00033] Figure 6 shows a peer node 600 in accordance with an embodiment of the present invention. As shown in Figure 6, the peer node 600 comprises: an initiate unit 602, configured to initiate a distributed transaction with one or more remote peer nodes, each of which is associated with multiple network addresses; a verify unit 604, configure to verify that the one or more remote peer nodes all have a same view of a system configuration; and an execute unit 606, configured to execute the distributed transaction via the multiple network addresses associated with the one or more remote peer nodes.

[00034] In one example, the system configuration includes at least one of one or more unique names associated with each peer node, a list of networks, and internet protocol (IP) address to reach each peer node.

[00035] In one example, before responding, the one or more remote peer nodes check whether local system configuration information is consistent with local OS/networking configuration.

[00036] In another example, one or more cooperating peer nodes are brought in synchronization when a change in network configuration happens, before one or more subsequent distributed transactions can be carried out.

[00037] In yet another example, no distributed transaction is initiated during a period when network configuration is inconsistent among cooperating peer nodes.

[00038] In an example, the peer node 600 further comprises a detect unit 608, configured to detect a change in a list of cooperating peers.

[00039] In one example, one or more network configuration updates are performed automatically or manually.

[00040] For example, the one or more network configuration updates do not cause either the peer node or any remote peer node to have a stale view of the system configuration.

[00041] In one example, the network addresses are dynamically changed during the execution of the distributed transaction.

[00042] It is noted that the units shown by dotted lines are optional. The various units disclosed herein may be implemented or performed with hardware, software or the combination thereof. They may be implemented or performed with a general purpose, single-or multi-chip processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, or, any conventional processor, controller, microcontroller, or state machine. A processor also may be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration. In some implementations, the units may be implemented by circuitry that is specific to a given function.

[00043] The present invention may be conveniently implemented using one or more conventional general purpose or specialized digital computer, computing device, machine, or microprocessor, including one or more processors, memory and/or computer readable storage media programmed according to the teachings of the present disclosure. Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art.

[00044] In some embodiments, the present invention includes a computer program product which is a storage medium or computer readable medium (media) having instructions stored thereon/in which can be used to program a computer to perform any of the processes of the present invention. The storage medium can include, but is not limited to, any type of disk including floppy disks, optical discs, DVD, CD-ROMs, microdrive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices, magnetic or optical cards, nanosystems (including molecular memory ICs), or any type of media or device suitable for storing instructions and/or data.

[00045] The foregoing description of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations will be apparent to the practitioner skilled in the art. The modifications and variations include any combination of the disclosed features. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, thereby enabling others skilled in the art to understand the invention for various embodiments and with various modifications that are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalence.