OF SERVERS IN A DATA CENTER

RELATED APPLICATIONS

[0001] This application claims priority to U.S. Provisional Application No. 61/800,707, also entitled "Atmospheric Cooling of Servers in a Data Center", filed on March 15, 2013, and hereby incorporates by reference the disclosure of that application.

BACKGROUND

[0002] The microprocessor and other integrated circuits in a server generate a significant amount of heat which is exhausted from the computer using a computer fan.

[0003] A data center or "server farm" might contain hundreds of servers in racks, resulting in large amounts of heat that could interfere with operation of the servers (e.g., the circuitry on motherboards), if not dissipated.

[0004] For this reason, some organizations that maintain data centers locate them in geographic locations in cooler climes. However, those cooler climes can present problems of their own when environmental temperatures fall to levels that retard the operation of moving parts, such as hard disk drives, in servers.

SUMMARY

[0005] In an example embodiment, an apparatus is described. The apparatus is a building for a data center (or server farm). The building includes a stack structure that interfaces with an environment and one or more housings coupled to a floor and the stack structure. Each of the housings includes one or more racks with a plurality of servers and each of the servers includes a computer fan capable of varying speed or reversing direction. The building also includes one or more filters between the one or more housings and the environment and one or more walls operable to be between the one or more filters and the environment.

[0006] In another example embodiment, an apparatus is described. The apparatus is a building for a data center (or server farm). The building includes an attic coupled to a floor. The attic includes a stack structure that interfaces with an environment. The building also includes one or more housings coupled to the floor. The attic includes a bottom surface that is coupled to the one or more housings. Each of the housings includes one or more racks with a plurality of servers and each of the servers includes a computer fan capable of varying speed or reversing direction. The building also includes one or more filters between the one or more housings and the environment and one or more walls operable to be between the one or more filters and the environment.

[0007] Another example embodiment also involves a method. According to the method, a geographic location is ascertained where the rate of environmental temperature change per time interval is relatively small. Then a building is erected at the ascertained geographic location. The building includes a stack structure that interfaces with an environment and one or more housings coupled to a floor and the stack structure. Each of the housings includes one or more racks with a plurality of servers and each of the servers includes a computer fan capable of varying speed or reversing direction. The building also includes one or more filters between the one or more housings and the environment and one or more walls operable to be between the one or more filters and the environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is an external view of a building that houses servers for a data center (or server farm).

[0009] Figure 2 is another external view of a building that houses servers for a data center.

[0010] Figure 3 is an internal view of a building that houses servers for a data center.

[0011] Figure 4 is an external view of a housing for servers in a building for a data center.

[0012] Figure 5A is a diagram showing an internal view of a building that houses servers for a data center, in accordance with an example embodiment.

[0013] Figures 5B and 5C are diagrams showing controllable computer fans, in accordance with an example embodiment.

[0014] Figure 5D is a diagram showing an internal view of a housing for servers in a building for a data center, in accordance with an example embodiment.

[0015] Figure 5E is a diagram showing an internal view of a building that houses servers for a data center, in accordance with another example embodiment.

[0016] Figure 5F is a diagram showing an internal view of a building that houses servers for a data center, in accordance with another example embodiment.

[0017] Figure 6 A is a diagram showing air flows in a building that houses servers for a data center, in accordance with an example embodiment.

[0018] Figure 6B is a diagram showing air flows in a building that houses servers for a data center, in accordance with another example embodiment.

[0019] Figure 7 is a flowchart diagram that illustrates a process for atmospheric cooling of servers in a data center, in accordance with an example embodiment. DETAILED DESCRIPTION

[0020] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the exemplary embodiments. However, it will be apparent to one skilled in the art that the example embodiments may be practiced without some of these specific details. In other instances, process operations and implementation details have not been described in detail, if already well known.

[0021] Figure 1 is an external view of a building that houses servers (e.g., servers) for a data center (or server farm). As shown in this figure, building 101 might include a stack (or chimney) structure 102 with windows 103. In an example embodiment, windows 103 might have screens or louvers that protect the interior of building 101 from such things as environmental particulates (including moisture) and/or debris (e.g., leaves, grass, dirt, sand, etc.). It will be appreciated that the stack structure 102 facilitates the movement of relatively warm (e.g., air that has been warmed by the servers in the data center) air out of building 101 into the environment, through the use of the stack effect or buoyancy. In an example embodiment, the floor for building 101 might be approximately 80 feet by approximately 150 feet and the height of the building from the floor to the top of stack structure 102 might be approximately 33 feet. Also as shown in Figure 1, administrative personnel might access the servers inside the data center through a door in building 101.

[0022] Figure 2 is another external view of a building that houses servers for a data center.

As shown in this figure, building 101 might include a number of mixing chambers, such as mixing chamber 201, which facilitate the movement of relatively cool air (e.g., air that has not been warmed by the servers in the data center) from the environment into the building 101. In an example embodiment, mixing chamber 201 might have screens or louvers that protect the interior of building 101 from such things as environmental particulates (including moisture) and/or debris (e.g., leaves, grass, dirt, sand, etc.). It will be appreciated as shown in Figure 2, relatively cool air (a) might enter building 101 through mixing chamber 201, (b) be warmed by servers inside building 101, and (c) exit building 101 through window 103 in stack 102.

[0023] Figure 3 is an internal view of a building that houses servers for a data center. As shown in this figure, mixing chamber 201 is a mixing chamber viewed from the interior of the building, rather than the exterior of the building, as in the prior figure. Mixing chamber 201 might include a fan 301 and a door 302 and be approximately 5 feet long by approximately 15 feet wide and approximately 12 feet high. The door 302 allows administrative personnel to enter mixing chamber 201, e.g., to replace or adjust screens or louvers. Fan 301 might be used to wholly or partially counteract the air pressure drop that results from mixing chamber 201. It will be appreciated that an air pressure drop might result from the frictional obstruction of air flowing into a constrained space such as mixing chamber 201.

[0024] As explained in co-owned U.S. Patent Application No. 2011/0009047, entitled

Integrated Building Based Air Handler for Server Farm Cooling System", filed on July 9, 2009, by Noteboom and Robinson (which is hereafter referred to as "Noteboom"), mixing chamber 201 might be used to warm relatively cold air from the environment (e.g., 35 degrees Fahrenheit) by mixing it with air warmed by the servers in the building and re-circulated into the mixing chamber through, e.g., the use of dampers. Such warming might be used to achieve a desired consistent temperature for air proximate to the servers, e.g., in the range of approximately 65-95 degrees Fahrenheit, with 85 degrees Fahrenheit being nominal. It will be appreciated that such a desired consistent temperature might promote server operability (e.g., reading and writing by a hard disk drive) and/or prolong server life (e.g., reduce damage to connections on a motherboard). In an alternative scenario, mixing chamber 201 might include an evaporative or "swamp" cooler (e.g., with an evaporative media such as a fiberglass pad in water) that is used to cool (e.g., using adiabatic cooling) relatively warm air from the environment (e.g., above 85 degrees Fahrenheit) to a desired consistent temperature, e.g. in the range of approximately 65-95 degrees Fahrenheit, with 85 degrees Fahrenheit being nominal.

[0025] Also shown in Figure 3 is a housing 303 for servers with a door 304 that allows administrators to enter the housing and maintain or replace servers, e.g., in racks inside the housing. Figure 4 also shows housing 303 and door 304. It will be appreciated that housing 303 is supported by the building's floor 402, but is elevated above floor 402 (e.g., a cement floor) to allow air (e.g., air blown by the fan out of the mixing chamber) to reach the servers in the racks in housing 303. Figure 4 also shows a ceiling 401 which is tightly connected to housing 303, e.g., to prevent the escape of air that has been warmed by the servers and which is being routed to the building's stack, e.g., by computer fans in the servers. It will be appreciated that ceiling 401 creates an enclosed attic space in the building above the housings such as housing 303.

[0026] Figure 5A is a diagram showing an internal view of a building that houses servers for a data center, in accordance with an example embodiment. As shown in this figure, the building includes a roof 501 and a stack (or chimney) structure 502a through which air from the building can flow into the environment. The building also includes housings for servers, such as housing 503, which includes a rack of servers (e.g., blade servers). Each server, such as server 504, includes (a) one or more processors (e.g., a microprocessor) such as processor 505 and (b) one or more (e.g., 1, 2, or 3) computer fans such as computer fan 506, which might be variable as to activation, speed, direction, etc. Housing 503 is supported by the building floor 511 and connects to stack structure 502a. Stack structure 502a includes damper 509, which can be used to trap relatively warm air flowing out of the servers in housing 503 into the stack structure 502a. [0027] As also depicted in Figure 5A, a filter 507 (e.g., an air filter and/or a mesh filter) protects the interior of the building from such things as environmental particulates (including moisture) and/or debris (e.g., leaves, grass, dirt, sand, etc.). Roll-up wall 510 can be used to keep out air from the environment, e.g., air which is relatively cold in comparison to air in the building. Roll-up wall 510 can also be used for protection against wind, moisture, debris, and or other environmental hazards that are not fully protected against by filter 507. In an example embodiment, roll-up wall 510 might be manually operated or automated.

[0028] Also shown in Figure 5A is controller 508 which might control computer fan 506, damper 509, and/or roll-up wall 510, in an example embodiment. Controller 508 might include a computer device with software, firmware, and/or hardware (e.g., a microprocessor and volatile and/or persistent storage) connected to one or more sensors (e.g., a sensor that measures

temperature, humidity, air pressure, particulate matter, etc.). In an example scenario, controller 508 might determine that the temperature of the air proximate to the servers has risen at a rate above the server manufacturer's maximum allowable rate of change upwards, e.g., nine degrees Fahrenheit within one hour. And therefore, controller 508 might cause (e.g., through a command transmitted over a wire or wirelessly) the computer fans in the servers (such as computer fan 506) to operate at a higher speed. In another example embodiment, controller 508 might be a component of server 504 and/or its computer fan 506, rather than external to server 504 a shown in Figure 5A. Alternatively, controller 508 might remedy the rising temperature by opening the damper 509 or raising one or more of the roll-up walls (e.g., roll-up wall 510), e.g., through a command transmitted over a wire or wirelessly.

[0029] Or in another example scenario, controller 508 might determine that the temperature of the air proximate to the servers has dropped at a rate that exceeds the server manufacturer's maximum allowable rate of change downward, e.g., nine degrees Fahrenheit within one hour. And therefore, controller 508 might cause (e.g., through a command transmitted over a wire or wirelessly) the computer fans in the servers (such as computer fan 506) to turn in a direction that reduces the flow of warm air from the servers (such as server 504) into the stack structure 502a. Here again, in another example embodiment, controller 508 might be a component of a server 504 and/or its computer fan 506, rather than external to server 504 a shown in Figure 5A. Alternatively, controller 508 might remedy the falling temperature by closing the damper 509 or lowering the roll- up walls (e.g., roll-up wall 510), (e.g., through a command transmitted over a wire or wirelessly).

[0030] It will be appreciated that the building shown in Figure 5A does not include a mixing chamber as described above. This provides economic benefits both at the time of construction of the building (e.g., the construction cost of the mixing chamber is avoided) and throughout the building's lifetime (e.g., no ongoing operational/maintenance costs related to the mixing chamber's fan, the building can accommodate more servers, etc.).

[0031] It will be further appreciated that the building in Figure 5 A does not maintain a consistent temperature with respect to air proximate to the servers in the data center. Rather, the controller 508 monitors whether the temperature proximate to the servers has dropped (or risen) at a rate that exceeds the server manufacturer's maximum allowable rate of change downward (or upward), e.g., nine degrees Fahrenheit within one hour. As discussed in further detail elsewhere, the probability of such a temperature change can be reduced through appropriate selection of a geographic location for the building. In many instances, geographic locations in relatively colder climes might not be appropriate selections.

[0032] Figures 5B and 5C are diagrams showing controllable computer fans, in accordance with an example embodiment. As shown in Figures 5B and 5C, a server 504 (e.g., a blade server) includes two computer fans (e.g., computer fan 506) and a processor 504 (e.g., a microprocessor) which generates heat during operation. The direction (e.g., blade spinning counterclockwise) of the computer fan 506 in Figure 5B causes the relatively warmer air resulting from exposure to processor 505 to be expelled from the server 504, e.g., into the stack structure described above with respect to Figure 5A. It will be appreciated that the cooling effect depicted in Figure 5B might also be achieved by increasing the speed of the computer fans or by opening a damper between the server and the stack structure.

[0033] In Figure 5C, the direction (e.g., blade spinning clockwise) of the computer fan 506 causes the relatively warmer air resulting from exposure to processor 505 to be pulled (or pushed) toward the computer fan 504, e.g., away from the stack structure described above with respect to Figure 5 A. It will be appreciated that the warming effect depicted in Figure 5C might also be achieved by shutting off the computer fans or by lowering a damper between the server and the stack structure.

[0034] Figure 5D is a diagram showing an internal view of two housings for servers in a building for a data center, in accordance with an example embodiment. The viewpoint of this figure is from the top of the housings (e.g., housing 503). Each server (such as server 504) that is shown is the top server on a rack of servers. That is to say, beneath each server that is shown are number of other servers (e.g., a dozen blade servers) in a rack. It will be appreciated that all of the servers are blowing relatively warm air (e.g., air warmed by a processor) into the stack structure 502a. A door 511 allows administrative personnel to enter the space between to the two housings (e.g., the bottom of the stack structure 502a).

[0035] Figure 5E is a diagram showing an internal view of a building that houses servers for a data center, in accordance with another example embodiment. As shown in this figure, the building includes a roof and a stack (or chimney) structure 502b through which air from the building can flow into the environment. The building also includes housings for servers, such as housing 503 (shown within the broken line), which includes two racks of servers (e.g., blade servers) spaced so as to allow access to the servers by administrative personnel. Housing 503 is supported by the building floor and connects to stack structure 502b through an opening in ceiling 513. It will be appreciated that ceiling 513 creates an attic space with the stack structure 502b, e.g., similar to the attic space described in Noteboom. In an example embodiment, housing 503 might provide structural support for other components of the building, including the ceiling 513, the attic space, the stack structure 502b, the roof, etc. It will also be appreciated that air warmed by the servers might rise into the attic space before exiting into the environment through the stack structure 502b.

[0036] As also depicted in Figure 5E, a filter 507 (e.g., an air filter and/or a mesh filter) protects the interior of the building from such things as environmental particulates (including moisture) and/or debris (e.g., leaves, grass, dirt, sand, etc.). Roll-up wall 510 can be used to keep out air from the environment, e.g., air which is relatively warm or relatively cold in comparison to air in the building. Roll-up wall 510 can also be used for protection against wind, moisture, debris, and or other environmental hazards that are not fully protected against by filter 507. In an example embodiment, roll-up wall 510 might be manually operated or automated. A controller such as the controller described above might be used to control computer fans and roll-up wall 510, in an example embodiment.

[0037] Figure 5F is a diagram showing an internal view of a building that houses servers for a data center, in accordance with another example embodiment. As shown in this figure, the building includes a roof 501 and a stack (or chimney) structure 502a through which air from the building can flow into the environment. The building also includes housings for servers, such as housing 503, which includes a rack of servers (e.g., blade servers). Each server, such as server 504, includes (a) one or more processors (e.g., a microprocessor) and (b) one or more (e.g., 1, 2, or 3) computer fans such as computer fan 506, which might be variable as to activation, speed, direction, etc. Housing 503 is supported by the building floor 511 and connects to stack structure 502a. Stack structure 502a includes fan 515, which might be (a) variable as to activation, speed, direction, etc., and (b) used to pull (or push) warm air flowing out of the servers in housing 503 into the stack structure 502a.

[0038] As also depicted in Figure 5F, a filter 507 (e.g., an air filter and/or a mesh filter) protects the interior of the building from such things as environmental particulates (including moisture) and/or debris (e.g., leaves, grass, dirt, sand, etc.). Louvered wall 514 might be used to keep out air from the environment, e.g., air which is relatively warm or relatively cold in

comparison to air in the building. Louvered wall 514 might also be used for protection against wind, moisture, debris, and or other environmental hazards that are not fully protected against by filter 507. In an example embodiment, louvered wall 514 might be manually operated or automated. In an example embodiment, louvered wall 514 might include louvers whose size and spacing (e.g., a louvered wall with a relatively large number of louvers) have been selected so as to reduce the air pressure drop resulting from the presence of louvered wall 514.

[0039] Also shown in Figure 5F is controller 508 which might control computer fan 506, fan

515, and/or the louvers in louvered wall 514, in an example embodiment. Controller 508 might include a computer device with software, firmware, and/or hardware (e.g., a microprocessor and volatile and/or persistent storage) connected to one or more sensors (e.g., a sensor that measures temperature, humidity, air pressure, particulate matter, etc.). In an example scenario, controller 508 might determine that the temperature of the air proximate to the servers has dropped (or risen) at a rate that exceeds the server manufacturer's maximum allowable rate of change downward (or upward), e.g., nine degrees Fahrenheit within one hour. And therefore, controller 508 might cause (e.g., through a command transmitted over a wire or wirelessly) the computer fans in the servers (such as computer fan 506) to operate at a higher speed. In another example embodiment, controller 508 might be a component of a server 504 and/or its computer fan 506, rather than external to server 504 a shown in Figure 5F. Alternatively, controller 508 might remedy the rising temperature by activating (e.g., through a command transmitted over a wire or wirelessly) fan 515 or opening (e.g., through a command transmitted over a wire or wirelessly) the louvers in one or more of the louvered walls (e.g., louvered wall 514). It will be appreciated that fan 515 will supplement heat rejection by the server fans when the temperature of the air proximate to the servers has risen at a rate that exceeds the server manufacturer's maximum allowable rate of change upward, e.g., nine degrees Fahrenheit within one hour.

[0040] Or in another example scenario, controller 508 might determine that the temperature of the air proximate to the servers has dropped at a rate that exceeds the server manufacturer's maximum allowable rate of change downward, e.g., nine degrees Fahrenheit within one hour. And therefore, controller 508 might cause (e.g., through a command transmitted over a wire or wirelessly) the computer fans in the servers (such as computer fan 506) to turn in a direction that reduces the flow of warm air from the servers into the stack structure 502a. Here again, in another example embodiment, controller 508 might be a component of a server 504 and/or its computer fan 506, rather than external to server 504 as shown in Figure 5F. Alternatively, controller 508 might remedy the falling temperature by deactivating (e.g., through a command transmitted over a wire or wirelessly) the fan 515 or closing (e.g., through a command transmitted over a wire or wirelessly) the louvers in one or more of the louvered walls (e.g., louvered wall 514).

[0041] Or in still another example scenario, controller 508 might determine that there has been a significant change (e.g., an increase) in the particulate matter in filter 507 (e.g., as measured by a sensor in filter 507) during a period of time (e.g., one hour), as a result of a forest fire or sandstorm. And therefore, controller 508 might activate fan 515 to increase the air flow and pull (or push) air away from the servers and into the stack structure 502a.

[0042] Figure 6A is a diagram showing air flows in a building that houses servers for a data center, in accordance with an example embodiment. As depicted in this figure, air flows from the environment outside the building through the filter 507 (e.g., an air filter and/or a mesh filter) into a housing that includes a rack of servers (e.g., blade servers). The air is warmed by each server (e.g., by the server's processors or other integrated circuits) and is pulled (or pushed) by the servers' computer fans (e.g., computer fan 506) into the stack structure 502a. The warmed air then exits back into the environment through windows at the top of the stack structure 502a. In an example embodiment, all or part (e.g., the top part) of the stack structure 502a might be made of materials that warm the stack structure 502a (e.g., concrete) and enhance its stack effect. Or, all or part (e.g., the top part) of the stack structure 502a might include components such as mirrors that warm the stack structure 502a (e.g., concrete) and enhance its stack effect. Similarly, the length of the stack structure 502a might be extended to enhance its stack effect, in an example embodiment.

[0043] Figure 6B is a diagram showing air flows in a building that houses servers for a data center, in accordance with another example embodiment. As depicted in this figure, air flows from the environment outside the building through the louvered wall 514 and the filter 507 (e.g., an air filter and/or a mesh filter) into a housing that includes a rack of servers (e.g., blade servers). The air is warmed by each server (e.g., by the server's processors or other integrated circuits) and is pulled (or pushed) by the servers' computer fans (e.g., computer fan 506) away from the stack structure 502a. It will be appreciated that such an air flow might be used to warm the servers, e.g., when there has been a significant drop in the temperature of the air proximate to the servers within a short period of time.

[0044] Figure 7 is a flowchart diagram that illustrates a process for atmospheric cooling of servers in a data center, in accordance with an example embodiment. In operation 701 of the process, an organization (e.g., an organization hosting a search engine, a social network, an online store, etc.) planning a data center ascertains a geographic location where the environmental temperature change per time interval is relatively small compared to other geographic locations (e.g., approximately nine degrees Fahrenheit per one hour). As indicated earlier, such a geographic location might not be in a cool clime. Then in operation 702, the organization erects (or constructs) a building at the ascertained geographic location, where the building might include: (a) a stack structure that interfaces with the environment; (b) multiple housings supported by a floor, where each housing includes one or more server racks with servers that each have a computer fan which might be variable as to activation, speed, direction, etc.; (c) multiple filters (e.g., air filters and/or mesh filters) between the housings and the environment; and (d) walls (e.g., roll-up or louvered) between the filters and the envirionment. In alternative embodiments, the building to be erected in operation 702 might include one or more of the other elements described elsewhere in this disclosure, e.g., a damper in the stack structure, a fan in the stack structure, an attic space, etc.

[0045] With the above example embodiments in mind, it should be understood that the example embodiments might employ various computer-implemented operations involving data stored in computer systems. These operations are those requiring physical manipulation of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. Further, the manipulations performed are often referred to in terms, such as producing, identifying, determining, or comparing.

[0046] Any of these operations might be useful machine operations. The example embodiments might also include a device or an apparatus for performing these operations. The device might be specially constructed for the required purposes or it may be a general purpose computer selectively activated or configured by a computer program stored in the computer. In particular, various general purpose computers may be used with computer programs written in accordance with the teachings herein.

[0047] The example embodiments might also include computer-readable code on a computer-readable medium. The computer-readable medium is any data storage device that can store data, which can thereafter be read by a computer system. Examples of the computer readable medium include hard drives, network attached storage (NAS), read-only memory, random-access memory, CD-ROMs, CD-Rs, CD-RWs, DVDs, Flash, magnetic tapes, and other optical and non- optical data storage devices. The computer-readable medium can also be distributed over a network coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion.

[0048] Although example embodiments have been described in some detail for purposes of clarity of understanding, it will be apparent that certain changes and modifications can be practiced within the scope of the following claims. Accordingly, the example embodiments are to be considered as illustrative and not restrictive, and the inventions are not to be limited to the details given herein, but may be modified within the scope and equivalents of the following claims. In the following claims, elements and/or steps do not imply any particular order of operation, unless explicitly stated in the claims or implicitly required by the disclosure.

What is claimed is: