MULTIPLE VIRTUAL OPERATING ENVIRONMENTS

FIELD OF INVENTION

[0001] The present invention generally relates to managing network connectivity, and more particularly to an automated system and method for use in managing and provisioning of bandwidths between network zones in order to accommodate the predetermined workloads.

BACKGROUND OF INVENTION [0002] Cloud services entails managing networks of data centers so as to meet the demands and requirements from users. In order to avoid latency particularly in delivering large workloads, geo-diversity has been favoured to increase reliability and prevent outage of an entire networking site. Further, there can be circumstances where network segregation is essential to accommodate various requirements of multitenant environment as well as service-level agreement (SLA) associated with multiple and differing tenants.

[0003] Albeit the current proficiencies of geo-distributed networks, without appropriate design and management, these geo-diverse data center networks can result to increase of cost in providing the relevant services. Meticulous tasks in managing data centers are performed manually, which is one of the major drawbacks of the conventional methods and systems. These tasks may include, and not limiting to, bandwidth adjustments, and optimizing network utilization. The complexity increases in the event that there are multiple zones, which are disposed across multiple virtual operating environments, thus may necessitate multiple networks. In addition, services are often oblivious of the network topology in order to benefit from it. Nevertheless, cloud service providers are adamant in fully utilizing the respective bandwidth while efficiently maintaining the tenant SLA.

[0004] Thus, there remains a considerable need for systems and methods that can conveniently address the above-discussed shortcomings managing network communications in order to accommodate and deliver services and applications to end- users.

SUMMARY

[0005] In one aspect of the present invention, there is provided a system for managing bandwidths between a plurality of zones with one tenant in a network based on a predetermined Service Level Agreement (SLA) and Quality of Service (QoS); the system comprising a Global Controller adapted for managing the bandwidths provisions and shaping for all zones; ensuring all zones fulfill the SLA and QoS; storing all information associated to the bandwidths for all zones; monitoring and reporting status of bandwidths for all zones; and a Zone Controller for each zone adapted to be in communication with the Global Controller such that all bandwidth status and information for each zone can be relayed to the Global Controller; the Zone Controller further adapted for managing bandwidths for each zone and ensuring SLA and QoS are fulfilled by each zone; wherein when the Global Controller receives a bandwidth request from the Zone Controller; the Global Controller automatically adjusts the bandwidth shaping and provisions based on said request for all zones and updates the bandwidth information for all zones.

[0006] In one embodiment of the present invention, the Global Controller comprises: a Tenant Manager module adapted to manage tenant registration, tenant SLA and request of at least one Virtual Machine (VM); a Global Dynamic Policy Manager module adapted to ensure the SLA and QoS is fulfilled collectively for all zones; a Global Bandwidth Manager module adapted to manage the bandwidth shaping and bandwidth provision collectively for all zones; and a Global Monitoring and Reporting module adapted to gather all information from all zones.

[0007] In a further embodiment of the present invention, Zone Controller comprises: a Dynamic Policy Handler module adapted to manage QoS and SLA fulfillment for each zone; a Bandwidth Handler module adapted to manage the bandwidth shaping and bandwidth provision for each zone; a VM Handler module adapted to manage all virtual machines (VM) for each zone and provide an interface for bandwidth management for each zone; and a Monitor and Reporting Agent module adapted to gather and report all data related to the bandwidths for each zone.

[0008] In another embodiment, the Tenant Manager module comprises at least one sub-module, which is adapted for: handling all tenant(s) registration process; creating new SLA; creating new zone controller(s); and handling VM requests for each zone.

[0009] In a further embodiment, the Global Controller further comprises: at least one database for storing and retrieval of SLA information; at least one database for storing and retrieval of zones information, at least one database for storing and retrieval of QoS policy information and at least one database for storing and retrieval of global bandwidth provision.

[0010] In yet another embodiment, the Zone Controller further comprises: at least one database for storing and retrieval of QoS policy information and at least one database for storing and retrieval of bandwidth provision information.

[0011] In another aspect of the present invention, there is provided a method for managing bandwidths between a plurality of zones based on a predetermined quality of service (QoS); the zones connected to at least one network comprising: providing at least one global controller for managing the adjustments and provisions of bandwidths for all zones collectively; providing at least one zone controller for managing the adjustments and provisions of bandwidths for each zone; and said zone controller being in communication with the global controller; updating the adjustments made for bandwidths and QoS for each zone to the global controller.

[0012] In a further embodiment, managing the adjustments and provisions of bandwidths for all zones collectively includes: registering at least one tenant; creating at least one service-level agreement (SLA) between the tenant and a service provider; creating a zone and a zone controller for each zone; assigning the zone to the tenant; the zone controller requesting a virtual machine (VM); determining and checking the utilization of bandwidths for each and all zones; ensuring the request fulfills the SLA and QoS; allocating a virtual machine (VM) to the zone controller; adjusting the bandwidths and allocating a bandwidth for the requesting zone controller.

[0013] In yet an embodiment of the present invention, ensuring the request fulfills

SLA and QoS includes sending a notification in the event that the QoS is not fulfilled.

[0014] In a further embodiment, the method further includes adjusting the QoS policy for each zone separately and all zones collectively.

[0015] In yet another embodiment, the method includes requesting a bandwidth and re-allocating at least one bandwidth for a zone.

BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The invention will be more understood by reference to the description below taken in conjunction with the accompanying drawings herein:

[0017] FIG. 1 describes an intra-zone bandwidth managing situation of which the method and system of the present invention can be implemented;

[0018] FIG. 2 describes an inter-zone bandwidth managing situation of which the method and system of the present invention can be implemented;

[0019] FIG. 3 is an overview of the bandwidth managing system in accordance with one embodiment of the present invention;

[0020] FIG. 4 shows the Tenant Manager module of the Global Controller in accordance with an embodiment of the present invention;

[0021] FIG.5 shows the Global Dynamic QoS Policy module of the Global Controller in accordance with an embodiment of the present invention;

[0022] FIG. 6 shows the Global Bandwidth Manager module of the Global

Controller in accordance with an embodiment of the present invention;

[0023] FIG. 7 shows the Dynamic QoS Policy Handler module of the Zone

Controller in accordance with an embodiment of the present invention; and

[0024] FIG. 8 shows the Bandwidth Handler module of the Zone Controller in accordance with an embodiment of the present invention. DETAILED DESCRIPTION

[0025] In line with the above summary, the following description of a number of specific and alternative embodiments is provided to understand the inventive features of the present invention. It shall be apparent to one skilled in the art, however that this invention may be practiced without such specific details. Some of the details may not be described at length so as not to obscure the invention. For ease of reference, common reference numerals will be used throughout the figures when referring to the same or similar features common to the figures. While the subject matter described herein is presented in the general context of program modules that execute in conjunction with the execution of application modules on a computer system, those skilled in the art will recognize that other implementations may be performed in combination with other types of program modules.

[0026] For the purpose of clear description and avoidance of doubt, the term

"global" or "global level" in this specification is used to mean overall or collective managing of a whole group of zones. In addition, "QoS" denotes quality of service and "SLA" defines service-level agreement for the purpose of the system and method of the present invention.

[0027] Broadly defined, the present invention provides an automated method and system for managing bandwidth resources so as to load balance the bandwidths in order to complete a workload for all devices connected to the network. The system and method of the present invention enables automated managing of bandwidths which include fault(s) detecting and dynamic provisioning of network connectivity based on multiple zones. In one embodiment, the present invention provides the ability to automatically adjust each zone bandwidth according to calculated quality of service (QoS) of monitor data. In another embodiment, the present invention automatically manages zoning across multiple virtual operating environments, which in turn span across multiple networks and provides virtualized system trunking, in a manner such that frames may be transferred on multiple virtual ports. The present invention further aids to optimize network utilization across zoning as well as multiple trunks and virtual ports. It should be understood that the method and system of the present invention can be implemented based on a single-tenancy or multi-tenancy architecture.

5

[0028] In one embodiment, the present invention enables management of intra- zone and inter-zone dynamic bandwidth adjustments. Generally, various software applications and services, which are accessed by end-users, are supported by a network of devices and resources accordingly allocated to carry out a certain workload based on the

10 respective applications and services. For such purpose, the allocation of resources and managing network utilization based on bandwidths entails the creation of "zones"; or the act of "zoning". FIG. 1 broadly illustrates an example of a situation of which the method and system can be implemented. FIG. 1 schematically describes the situation of an Intra- zone management; and more particularly dynamic bandwidth adjustment process. Zonel

15 101 comprises 10 units of bandwidth and assigned with three virtual machines (VM) 101a, 101b and 101c. Each of the virtual machines is using 3 units of bandwidth. After a period of time, one of the VMs may need to increase the units of bandwidth, for instance VM 101c. Accordingly, VM 101c requests the bandwidth from Zonel 101. As Zonel 101 has sufficient capacity of bandwidth, Zonel 101 thereby allocates the bandwidth to VM 101c. 0

[0029] FIG. 2 generally illustrates another example of a situation of which the method and system of the present invention can be implemented. FIG. 2 schematically describes the situation of managing inter-zones; more particularly the dynamic bandwidth adjustment process. Accordingly, there are two zones, referred herein as Zonel 201 and 5 Zone2 202. Each of the zones has 10 units of bandwidth. Zonel 201 has three VMs, 201a, 201b, 201c, while Zone2 202 has two VMs, and these are 202a and 202b. VM 201a, VM 201b, VM 202a and VM 202b are using 3 units of bandwidths. VM 201c requires and thus requesting 6 units of bandwidth. As Zonel 201 only has 10 units of bandwidths, Zonel 201 thereby is not able to fulfil the request by VM 201c. Nevertheless, Zone2 202 utilizes 0 only 6 units of bandwidth. Zonel 201 thereby requests for bandwidths from Zone2 202 in order to fulfil the request from VM 201c. Zone2 202 then allocates the bandwidths to Zonel 201.

[0030] FIG. 3 is an overview of the system in accordance with one embodiment of the present invention. The system comprises a Global Controller 310, a Zone Controller 410 and at least one Tenant 510. The Global Controller 310 is adapted to manage bandwidths for all zones at a global level or collectively. The Global Controller 310 comprises four modules and four databases, whereby the modules are: a Tenant Manager module 311, a Global Dynamic QoS Policy Manager module 312, Global Bandwidth Manager 313 and Global Monitor and Reporting module 314. The databases are SLA DB 320, Zone DB 330, Global QoS Policy DB 340 and Global Bandwidth Provision DB 350. All modules and sub-modules are adapted to be in communication with each other so as to enable the transfer and retrieval of information whenever required. [0031] The Tenant Manager module 311 of the Global Controller 310 comprises a Tenant Registrar 311A, an SLA processor 311B, a Zone Processor 311C and a VM processor 311D. Perceptibly this module may store and execute all data and tasks associated to tenants, SLAs and VM requests. The Tenant Manager module 311 is further configured to create new zone controller (s) with corresponding configurations based on the SLAs.

[0032] The Global Dynamic QoS Policy Manager module 312 is adapted to manage and primarily ensures that the SLAs and QoS are fulfilled at a global level. Accordingly, it may store data and execute all tasks, which are associated to SLAs and QoS. The Global Bandwidth Manager 313 is adapted to manage the bandwidth shaping and provisions at a global level, thus stores all data associated to bandwidth shaping and provisions at a global level. The Global Bandwidth Manager module 313 is further adapted to communicate with the Zone Controller 410 particularly in any changes associated to the bandwidth shaping and provisions. The Global Monitor and Reporting module 314 is adapted to obtain or extract information associated to current status at a global level and collect information from the Zone Controller 410. It is further adapted to generate reports whenever required by the system.

[0033] The Zone Controller 410 is adapted to be in communication with the

5 Global Controller 310 such that all data and information associated to each zone can be relayed or provided to the Global Controller 310. In accordance with an embodiment of the present invention, the Zone Controller 410 comprises four modules and two databases. The modules include a Dynamic QoS Policy Handler module 411, a Bandwidth Handler module 412, a VM Handler module 413 and a Monitoring and Reporting Agent module

10 414. The databases include QoS Policy DB 420 and Bandwidth Provision DB 430. In accordance with an embodiment, Dynamic QoS Policy Handler module 411 is adapted to manage and ensure the QoS and SLA are accordingly fulfilled at the Zone Controller 410 level. The Bandwidth Handler module 412 is adapted to manage the bandwidth shaping and bandwidth provision in the Zone Controller 410 level. In one embodiment, the VM

15 Handler module 413 may include an interface in the form of a hypervisor, adapted to suitably provide a programmable interface to the VM Handler module 413.

[0034] The Bandwidth Handler module 412 of the Zone Controller 410 comprises an Inter-Zone Processor 412A for handling the communication between the Zone 0 Controller 410 and the Global Controller 310 in matters related to bandwidth issues; a Bandwidth Provision processor 412B for changing of bandwidth provision at the zone level and updating the Bandwidth Provision Database 430; and a Bandwidth Shaping Processor 412C adapted for changing the bandwidth shaping within the zone based on notification issued by the Global Controller 310.

5

[0035] A system incorporating the method of the present invention will now be described in accordance with an embodiment of the present invention. Now referring to FIG. 4, the Tenant Manager module 311 of the Global Controller 310 aids to manage and register at least one Tenant 510 in the system. The process starts at 400, whereby upon 0 initiated and registered the tenant 510 at 401, the Tenant Manager 311 generates an SLA between the tenant 510 and the respective provider at 402. At this juncture, all SLAs are accordingly stored in the SLA Database 320. Upon completed the registration, the Global Controller 310 creates at least one zone controller at 403 and assigns the zone controller to the respective tenant 510. After the zone has been created, the tenant 510 will be able to request at least one VM at 404. Further in accordance with an embodiment of the present invention, the Tenant Manager module 311 determines at 405 whether there is still available bandwidth for allocation to the newly requested VM by way of obtaining information of the current bandwidth from the Global Monitor and Reporting module 314. In the event that the number of bandwidth available is fully utilized, the Tenant Manager module 311 sends a notification 405A that a request for a bandwidth will not be handled at current time. However if there is at least one available bandwidth available or all bandwidths are not utilized, the Tenant Manager module 311 then reverts to determining whether the request fulfilled the SLA at 405B. In any event that the tenant 510 violates the SLA, the Tenant Manager module 311 will notify the tenant 510. Upon confirmed that the SLA is fulfilled, the Tenant Manager module 311 creates a VM based on the request at 406 and allocates the VM to the corresponding zone at 407. Finally at 408, the Tenant Manager module 311 notifies the Global Bandwidth Manager 313 on updates of bandwidth provision.

[0036] FIG. 5 describes the Global Dynamic QoS Policy Manager module 312 of the Global Controller 310 in accordance with an embodiment of the present invention. Upon initiated at 500, the Global Monitor & Reporting Module 314 will provide information to the module to ensure the Global Dynamic QoS Policy module 312 is fulfilled based on predetermined intervals at 501. In the event that the QoS is fulfilled, the process is directed to Global Monitoring state at 501. In the event that the QoS is not fulfilled, a form of notification is generated and sent to the Global Bandwidth Manager 313 at 502. Adjustments and updates associated to Global Dynamic QoS Policy Manager 312 may be performed at 503 based on the participations or registrations of new tenants.

[0037] FIG. 6 describes the Global Bandwidth Manager module 313 of the Global Controller 310 in accordance with an embodiment of the present invention. To perform its tasks, the Global Bandwidth Manager module 313 may comprise of a Bandwidth Request Processor 313A, a Bandwidth Provision Processor 313B and a Bandwidth Shaping Processor 313C. It should be mentioned that for this module 313 a hold down timer is used to prevent PING-PONG effect. Upon initiated at 600, the Bandwidth Handler 412 proceeds to request bandwidths at 601. The module then determines whether the timer has expired or has not expired at 602. In the event that the hold timer expires at 602A, the module 313 proceeds to determine whether the expiry persistently occurs. If it persistently occurs at 603A, the adjustments of bandwidth provision 604 at a global level. The Global Tenant Manager 311 at 605 may provide updates on the global bandwidth provision. In the event that the timer has not expired, the module 313 then reverts to the Global and Monitoring module 314, at 602B. Further, in the event that the timer expires but it not persistent 603B, the module 313 proceeds with adjusting the bandwidth shaping at 606. The Bandwidth Handler 412 then accordingly provides updates on the adjustments of bandwidth provisions and shapings, which may have taken place at each zone to the Global Bandwidth Manager 313 and the same foi ^¬ adjustments which may have taken place at a global level. The Global Dynamic QoS Policy Manager module 312 is also adapted to send any requests that do not fulfil the global QoS policy to the Global Bandwidth Manager module 313 at 607 to determine whether the hold down timer has expired. As described earlier, in the event that the timer has expired, the process comprising steps 602A to 605 is repeated. In the event that the timer has yet to expire, the process of 602B is repeated.

[0038] FIG. 7 describes the Dynamic QoS Policy Handler module 411 of the

Zone Controller 410 in accordance with an embodiment of the present invention. The Dynamic QoS Policy Handler module 411 operates with the aid of the Monitor and Reporting Agent module 414; whereby upon initiated at 700, the Monitor and Reporting module 414 collects and provides information to the Dynamic QoS Policy Handler module 411 in order to determine whether the Dynamic QoS policy is accordingly at 701. In the event that the QoS policy is fulfilled at 701A, the information in relation to the fulfilled QoS policy is sent to the Bandwidth Handler 412. In the event that the QoS policy is not fulfilled, the Dynamic QoS Policy Handler module 411 sends a notification to the Bandwidth Handler 412 at 701B. The Global Dynamic QoS Policy Manager 312 is also notified in this process and thus generates updates to be sent to the Dynamic QoS Policy Handler 411. Upon receipt of the updates and information from the Global Dynamic QoS Policy Manager module 312, the Dynamic QoS Policy Handler module 411 proceeds to adjust the dynamic QoS policy accordingly at 702. Any updates will be stored in a QoS Policy database 420.

[0039] FIG. 8 describes the Bandwidth Handler module 412 of the Zone

Controller 410 in accordance with an embodiment of the present invention. Similar to that of the Global Bandwidth Manager module 313, the Bandwidth Handler module 412 applies a hold down timer so as to prevent PING-PONG effect. Upon initiated at 800, the Dynamic QoS Policy Handler 411 checks whether the QoS is fulfilled or not, whereby if it is detected that the QoS policy is not fulfilled at 801A, the Dynamic QoS Policy Handler module 411 determines the expiry of the timer at 802, and the notification is accordingly processed. From here, if the timer has expired at 802A, the module 412 proceeds to check whether the bandwidth for the respective zone has been fully utilized at 803. If the bandwidth of the zone is fully used at 803A, the module 412 checks whether the bandwidths for all zones are used at 804. If all zones bandwidths are fully utilized the process is reverted to the monitoring and reporting state at 804A. However, if not all bandwidths for all zones are utilized, a request for bandwidth to the Global Controller 310 is sent at 808. Accordingly, the request is relayed to the Global Bandwidth Manager module 313 for further processing and thus for adjustments of bandwidths at 806.

[0040] If the bandwidth at zone level is not fully utilized at 803B, the respective zone controller will check whether the request persistently occurs at 805. If the request does not persistently occur, a notification is sent at 805A and the bandwidth is adjusted accordingly at 806 by the Bandwidth Shaping Processor 412C. On the contrary, if the request persists, a notification is sent at 805B and the bandwidth provision is adjusted at 807 by the Bandwidth Provision processor 412B. The Shaping Processor 412C and Bandwidth Provision Processor 412B may update each other on the adjustments performed. [0041] In another situation in accordance with an embodiment of the present invention, if the QoS is accordingly fulfilled at 801B, the Bandwidth Handler module 412 checks whether anyone of the zones has requested bandwidth from other zones at 809. Then the module 412 checks if the number of bandwidths available is less or more than the requested bandwidth at 810. If the number of available bandwidth is less than the requested bandwidth, the module 412 proceeds to check whether the request persistently occurs at 810A. In the event that the request persistently occurs, a notification is sent to the Global Controller 310 in order to enable updating and adjusting the Global Bandwidth provision at 811. If the situation does not persistently occur, the process is reverted to the monitoring and reporting stage handled by the Monitoring and Reporting Agent module 414. If the number of the available bandwidth is more than that of the requested bandwidth, a notification is sent to the Global Controller 310 to proceed with re-allocation of bandwidth process at 812. A notification on the re-allocation of bandwidth is sent to the Global Bandwidth Manager module 313 at 815.

[0042] As would be apparent to a person having ordinary skilled in the art, the afore-described methods and components may be provided in many variations, modifications or alternatives to existing testing systems. The principles and concepts disclosed herein may also be implemented in various manner which may not have been specifically described herein but which are to be understood as encompassed within the scope and letter of the following claims.