FAQADE RENDERING SYSTEM

BACKGROUND

[0001] Oblique panoramic maps are panoramic maps that depict geographic areas in an oblique angle other than ninety degrees to depict map features, such as buildings or other landmarks, in relation to one another. At ninety degrees, the viewpoint of a map is from directly above the map features. Conversely, an oblique angle employs an angular viewpoint that is between zero degrees and ninety degrees to illustrate map features in a more representative depiction.

[0002] Cartographers in the 16th to early 19th centuries commonly employed oblique panoramic urban maps to illustrate urban areas. These maps made it easy for viewers to recognize landmark objects. However, the use of such maps disappeared with time as creating these types of maps involved extensive manual effort by skilled cartographers. Moreover, modern urban areas make such maps difficult to produce and use because of the large number of objects (e.g., buildings) that need to be included to make a representative map.

[0003] With the advent of modern technology, detailed modeling information is now available for many urban areas. Modeling information includes measurements and relative positions of objects in an area. Advances in computer graphics and visualization techniques have made it easier to render (e.g., draw or display) panoramic maps using this modeling information without the expense of sophisticated manual labor of cartographers. As an example, satellite imagery can be employed to render buildings on maps. This satellite imagery can be employed to render each building's fagade. A fagade of a building is a face of a building that generally includes windows and walls. For example, a skyscraper may have a different fagade than a townhouse in terms of windows of different sizes and shapes. Users can distinguish one building from another based on the buildings' fagades.

[0004] However, satellite imagery is unavailable from several positions and is often captured by satellites at different times of the day, and so shadows of objects can be in inconsistent places. Thus, when a viewer changes the viewpoint or zooms a map in or out, the buildings may not be illustratable in a visually

pleasing form because of these inconsistencies. Moreover, collecting and storing satellite imagery from multiple viewpoints and times of day can be costly in terms of time and storage. However, not storing this information makes it difficult to reproduce fagades of buildings.

SUMMARY

[0005] A fagade rendering system is described. The fagade rendering system can render a fagade of a building or other structure as a single unit instead of as an aggregation of parts by representing building fagades using waveform functions ("waveforms") to represent openings and orientations of parts of the fagades. The fagade rendering system can identify horizontal and vertical waveforms to represent portions of a fagade, combine the waveforms to generate fagade waveforms that model the fagade, and render the fagade waveforms as a fagade for the structure. The fagade rendering system can identify (e.g., by selecting or computing) waveforms for a building based on an analysis of the building's fagades. This analysis can be performed manually or automatically to classify building fagades according to a fagade complexity classification. This classification can be performed by analyzing an image of the building and an orientation in which the fagade is to be rendered. The fagade rendering system can select or compute one or more waveforms based on this classification. The fagade rendering system can then combine selected or computed waveforms both in the horizontal and in the vertical extents of a fagade to represent the fagade, such as to represent the fagade's openings (e.g., windows) and walls. When the fagade rendering system combines multiple waveforms it can use a multiplicative operation so that whenever any of the waveforms indicates a zero, the combined waveform also indicates zero. This portion of a waveform represents a window. Conversely, when the combination is not zero, the combined waveform can represent a wall or other non-window region of the fagade. The fagade rendering system can also vary attributes of the selected or computed waveforms, such as the length of a cycle of the waveform and the width of a curve within the cycle. As examples, the fagade rendering system can vary attributes to increase or decrease the width or height of windows. By combining waveforms to create the appearance of a fagade, the fagade rendering system can quickly render fagades without storing large amounts of data, such as satellite imagery.

[0006] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 is a block diagram illustrating components of a fagade rendering system in some embodiments.

[0008] Figure 2 is a flow diagram illustrating a model_fagade routine invoked by the fagade rendering system in some embodiments.

[0009] Figures 3-6 are waveform diagrams illustrating use of waveforms by the fagade rendering system in various embodiments.

[0010] Figure 7 is a flow diagram illustrating a renderjnap routine invoked by the fagade rendering system in some embodiments.

DETAILED DESCRIPTION

[0011] A fagade rendering system is described. In various embodiments, the fagade rendering system can render a fagade of a building or other structure as a single unit instead of as an aggregation of parts by representing building fagades using waveform functions ("waveforms") to represent openings and orientations of parts of the fagades. A waveform is a signal shape, such as sinusoidal, square, triangular, sawtooth, and so forth. The fagade rendering system can identify horizontal and vertical waveforms to represent portions of a fagade, combine the waveforms to generate fagade waveforms that model the fagade, and render the fagade waveforms as a fagade for the structure. The fagade rendering system can identify (e.g., by selecting or computing) waveforms for a building based on an analysis of the building's fagades. This analysis can be performed manually or automatically to classify building fagades according to a fagade complexity classification based on whether fagades have (1 ) significant wall and window regions; (2) only window regions; (3) a horizontal emphasis of layers of windows and walls; or (4) a vertical emphasis resulting from alternate columns of windows and walls. This classification can be performed by analyzing an image of the

building and an orientation in which the fagade is to be rendered. As an example, the fagade rendering system can employ triangular waveforms to represent rectangular windows that are oriented at an angle to a viewpoint. The fagade rendering system can select or compute one or more waveforms based on this classification. As an example, the fagade rendering system can select one set of waveforms for buildings with many complex wall and window regions and another set of waveforms for buildings with simpler window regions. The fagade rendering system can then combine selected or computed waveforms both in the horizontal and in the vertical extents of a fagade to represent the fagade, such as to represent the fagade's openings (e.g., windows) and walls. When the fagade rendering system combines multiple waveforms it can use a multiplicative operation so that whenever any of the waveforms indicates a zero, the combined waveform also indicates zero. This portion of a waveform represents a window. Conversely, when the combination is not zero, the combined waveform can represent a wall or other non-window region of the fagade. Thus, if the waveform indicates a wall in either the horizontal or vertical extents of a fagade, the fagade rendering system renders the result as a portion of the wall. If, on the other hand, the waveforms in both the horizontal and vertical directions indicate a window (e.g., they are zero), the fagade rendering system renders the position as a window. Thus, when the fagade rendering system combines waveforms horizontally and vertically to represent a building, the combination can represent the entire building fagade. The fagade rendering system can also vary attributes of the selected or computed waveforms, such as the length of a cycle of the waveform and the width of a curve within the cycle. As examples, the fagade rendering system can vary attributes to increase or decrease the width or height of windows. By combining waveforms to create the appearance of a fagade, the fagade rendering system can quickly render fagades without storing large amounts of data, such as satellite imagery. The fagade rendering system can then employ the combined waveforms to render windows and walls of the fagade. [0012] In various embodiments, a user can provide a level of abstraction to the building fagade rendering system. Alternatively, the fagade rendering system can compute an appropriate level of abstraction based on the user's selection of a zoom level. By creating abstractions, the fagade rendering system can avoid

extraneous details and make the map appear less cluttered. The fagade rendering system can employ the level of abstraction to tune the waveforms by varying the waveforms' parameters. As an example, when a high level of detail is desired, such as when the zoom level is very close, the fagade rendering system can combine multiple simple or complex waveforms to represent the fagade. Alternatively, when the zoom level is far or less detail can be rendered, the fagade rendering system can use a smaller number of waveforms, such as a simple square waveform for both the vertical and horizontal extents. In some embodiments, the fagade rendering system can receive as a parameter a number of waveforms to combine to model a fagade. Thus, if a higher level of detail is required, the fagade rendering system may receive a higher number of waveforms than if a lower level of detail is required. In various embodiments, the degree of fagade abstraction need not be tied to zoom levels and can instead be a result of a style parameter that is chosen by the user. If the user wants abstract maps, then the user can use fewer waveforms, else if they would like a detailed map appearance, then the fagade rendering system may use several waveforms for the same zoom level. In various embodiments, a user can vary a style parameter to cause the fagade rendering system to change the level of abstraction.

[0013] In various embodiments, the fagade rendering system can apply smoothing functions, such as a Fourier series, wavelets, or other mathematical functions to approximate waveforms. By applying smoothing functions, the fagade rendering system removes jaggedness and aliasing problems that are typical of simpler waveforms. When aliasing occurs, rendered waveforms can contain undesirable distortions. [0014] In various embodiments, the fagade rendering system can create various styles of maps, such as by depicting aspects of the fagades in various colors. As an example, a building at night can be simulated by coloring the background and walls black and coloring the windows with a lighter shade.

[0015] The fagade rendering system enables structures to be rendered at various times of the day. The fagade rendering system can employ various texturing techniques (e.g., using shading) to render the buildings during the day, at night, with interior lights, and so forth.

[0016] In some embodiments, the fagade rendering system employs Fourier series to model building fagades. By employing Fourier series, the fagade rendering system is able to perform anti-aliasing implicitly by truncating the evaluation of high frequency components. As a result, windows and walls can be rendered without hard edges.

[0017] The fagade rendering system will now be described with reference to the figures. Figure 1 is a block diagram illustrating components of a fagade rendering system in some embodiments. The fagade rendering system 100 can include terrain information 102, building information 104, waveform information 106, and fagade waveforms or model information 108. These components can be stored as databases, files, or other data storage types. The terrain information component 102 can include terrain-related information, such as from a geographical information system. The fagade rendering system can employ the terrain information to render terrain on a map. The building information component 104 stores building-related information, such as dimensions and locations of buildings in an urban area. As an example, the building-related information can include the location (e.g., in GPS or Cartesian coordinates), width, length, height, shape, and so forth. The building information can include similar information for any structure, such as landmarks or other map features. In some embodiments, the building information can include satellite or other imagery of buildings, such as images that can be analyzed to produce waveforms. The waveform information component 106 can generate or store waveform information, such as waveforms based on an image of a building. The fagade waveforms or model information 108 can include generated fagade waveforms or other information that the fagade rendering system can employ to render fagades.

[0018] The computing devices on which the object fagade rendering system operates may include one or more central processing units, memory, input devices (e.g., keyboard and pointing devices), output devices (e.g., display devices), storage devices (e.g., disk drives), and network devices (e.g., network interfaces). The memory and storage devices are computer-readable media that may store instructions that implement the object fagade rendering system. In addition, the data structures and message structures may be stored or transmitted via a data transmission medium, such as a signal on a communications link.

Various Communications links may be employed, such as the Internet, a local area network, a wide area network, or a point-to-point dial-up connection.

[0019] The object fagade rendering system may use various computing systems or devices, including personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, electronic game consoles, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. The object fagade rendering system may also provide its services to various computing systems, such as personal computers, cell phones, personal digital assistants, consumer electronics, home automation devices, and so on.

[0020] The object fagade rendering system may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, and so on that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.

[0021] Figure 2 is a flow diagram illustrating a model_fagade routine 200 invoked by the fagade rendering system in some embodiments. The fagade rendering system can invoke the model_fagade routine 200 to create a model of the fagade based on an image of the fagade. The routine begins at block 202. At block 204, the routine receives an image of a fagade. At block 206, the routine generates a horizontal waveform based on the received image. At block 208, the routine generates a vertical waveform based on the received image. In some embodiments, a user may provide horizontal and vertical waveforms. The routine may employ one or more waveforms to represent the walls and windows of the fagade represented by the image. As an example, the routine may employ square and triangular waveforms to represent the fagade. At block 210, the routine stores the generated waveforms. At block 212, the routine creates and stores a model of the fagade. The model can include an identification of one or more generated waveforms, in which orientation the waveforms are to be rendered, and attributes of the waveform. At block 214, the routine returns.

[0022] Figures 3-6 are waveform diagrams illustrating use of waveforms by the fagade rendering system in various embodiments. Figure 3 illustrates a fagade 306 having nine windows similar to a window 312. The window 312 can be represented by a square waveform 302 in the horizontal extent and a square waveform 304 in the vertical extent. The window 312 is formed by a cycle 308 of the waveform 302 and a cycle 310 of the waveform 304. By employing a multiplicative operation, the fagade rendering system renders the window 312 when both waveforms 302 and 304 indicate a zero (e.g., window). When either waveform 302 or 304 indicates non-zero (e.g., wall), the fagade rendering system renders a wall. The fagade rendering system can compute whether a window or wall is to be rendered by analyzing horizontal and vertical scanlines for the fagade.

[0023] Figure 4 illustrates a fagade 408 that is rendered with slightly more complicated waveforms. The fagade rendering system has employed two horizontal waveforms 402 and 404. When the waveforms 402 and 404 are combined, such as by using a multiplicative operation, a combined waveform 406 is produced. The illustrated fagade 408 was rendered with the combined waveform 406 and a vertical waveform that is similar to the vertical waveform 304 that was employed during the rendering of the fagade illustrated in Figure 3. [0024] Figure 5 illustrates a simple square waveform 500. In the vertical axis, the values are zero or one (non-zero). The waveform 500 can be approximated mathematically as follows:

In this equation, T is the interval, 2c is the part of the interval that the function is non-zero, and n is the number of harmonics (e.g., the full interval) that are evaluated. As an example, when rendering the fagade illustrated in Figure 3, the waveform 302 would be evaluated three times whereas when rendering the fagade illustrated in Figure 4, the waveform 402 would be evaluated two times and the waveform 404 would be evaluated three times. The values for T and c can be selected based on an analysis of the image from which the waveforms are computed.

[0025] By employing smoothing techniques, the fagade rendering system can align fagades with the overall structure that is being rendered. Thus, for example, windows can be made to appear to be on the same plane as the fagade of the structure. By aligning the fagade waveforms with the structure and thereby smoothening waveform approximations, the fagade will be consistent with the structure.

[0026] Figure 6 is an illustration of a more complex waveform 600. A triangular waveform 602 and a square waveform 604 can be combined, such as by employing a multiplicative operation, to produce a waveform 606. The waveform 606 can represent a complex wall or window pattern, such as an angular orientation.

[0027] Figure 7 is a flow diagram illustrating a renderjnap routine 700 invoked by the fagade rendering system in some embodiments. The fagade rendering system can invoke the renderjnap routine 700 when rendering a map with structures, such as buildings, landmarks, and so forth. The routine begins at block 702. At block 704, the routine creates a terrain map. As an example, the routine can retrieve terrain information and render a portion of the information as a terrain map, e.g., based on how much can be displayed on a screen or printed on a page. At block 706, the routine can shade the rendered terrain, such as based on elevation information indicated by the terrain information. At block 708, the routine selects horizontal and vertical waveforms for one or more buildings that are to be rendered. At block 710, the routine selects a repetition period for the selected waveforms based on the amount of detail that is to be rendered. This repetition can be based on the rendering size (e.g., zoom level) that is selected for rendering the fagade. At block 712, the routine combines and at block 714, the routine generates fagade waveforms. At block 716, the routine renders the fagade based on the combined and generated waveforms. In various embodiments, the routine may loop through the logic of blocks 708-716 for each building that is to be rendered. At block 718, the routine returns. [0028] Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts

described above are disclosed as example forms of implementing the claims. Accordingly, the invention is not limited except as by the appended claims.