APPLICATION

BACKGROUND

[0001] With the advent of spreadsheet applications, computer and computer software users have become accustomed to processing and manipulating enormous amounts of data and using spreadsheet functions to perform many simple to very complex calculations and organizational functions with their data. Typical spreadsheet solutions provide a grid made up of rows, columns and dividers for receiving and manipulating data. The structure of a spreadsheet grid provides easy layout in a visual way and makes it easy to change entire rows or columns of information by simply inserting, resizing and deleting rows or columns. Such a grid-structured spreadsheet also allows a simple way to reference other cells in the grid by allowing users to build complex solutions utilizing data and calculations. These calculations maintain integrity (i.e., adjust to changes) when new columns are inserted, content is cut/copied/pasted, and the like, and such grid-structured spreadsheets make this type of data manipulation easier to implement and understand.

[0002] In some cases, various pieces of data, data objects, and the like included in a spreadsheet document may be copied from the grid-structured spreadsheet for use in another spreadsheet or another document of a different type. Such cases occur where users feel overwhelmed by large seemingly endless spreadsheet grids and desire to move part of their data or various data objects (for example, tables, charts, summaries, and the like) to a different document type without the underlying row/column grid-structure of the spreadsheet to present the data in a way that is more professional, visually engaging, or easier to read and/or interpret.

[0003] Unfortunately, extracting data objects from a grid-structured spreadsheet for use with other spreadsheets or other documents of different types presents various drawbacks. First, present solutions do not allow a user to efficiently move data or data objects to and from one structure to another and, when moved, only the values but not any underlying formulas are retained. Second, such solutions can develop error situations when extracted data or data objects are subsequently manipulated outside of the originating spreadsheet. For example, if the user attempts to copy data or a data object that has been modified back into the grid-structured spreadsheet from which it came, similar error situations may occur. A way of allowing a user to pull data or data objects out of grid-structured spreadsheet and place them in an unstructured canvas where the pulled data objects may be freely arranged would be an improvement providing a technical advantage over the current state of the art because it would give the user the ability to present the data in a way that is more professional, visually engaging, or easier to read and/or interpret while retaining all of the sophisticated computational functionality of the spreadsheet application.

[0004] It is with respect to these and other considerations that the present invention has been made.

SUMMARY OF THE INVENTION

[0005] This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended as an aid in determining the scope of the claimed subject matter.

[0006] Embodiments of the present invention solve the above and other problems by providing seamless grid and canvas integration in a spreadsheet application. According to embodiments, one or more data objects may be pulled from a grid-structured spreadsheet application document and may be allowed to "float" on the grid-structured spreadsheet without regard to the underlying grid. References between data and computations in the floating data object are structured and maintained so that the floating object may be manipulated and increased/decreased without adversely affecting the underlying grid and such that both data and computational references between the floating data object and the underlying grid are maintained. If desired, the floating object may be pushed or inserted back into the grid at any location, and the references between data in the grid and data in the floating (now re-inserted) object are maintained regardless of the insertion point.

[0007] According to another embodiment, such a data object may be seamlessly placed on to a grid-less canvas-like user interface and from the canvas-like user interface back to a grid-structured spreadsheet without upsetting connections (data and computational) between the data object and the associated grid-structured spreadsheet from which the data object was pulled or extracted. That is, according to embodiments of the present invention, moving spreadsheet objects between a canvas-like user interface structure in a spreadsheet application and one or more "sheets" in a spreadsheet application document are seamlessly enabled while maintaining references and computational functions associated with data in the moved objects. In addition, an ability to disconnect spreadsheet objects from global calculations contained in an underlying grid-structured spreadsheet is enabled when using such objects on a spreadsheet canvas, floating such objects on a grid-structured spreadsheet, or pulling such objects f om and inserting such objects back into a spreadsheet.

[0008] The details of one or more embodiments are set forth in the accompanying drawings and description below. Other features and advantages will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that the following detailed description is explanatory only and is not restrictive of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Fig. 1 illustrates a system architecture in which embodiments of the present invention may be practiced.

[0010] Fig. 2A illustrates pulling or moving a data object from a grid-structured spreadsheet document for floating the pulled data object on to the spreadsheet document from which it was pulled.

[0011] Fig. 2B illustrates depositing the data object of Fig. 2A onto a grid-structured spreadsheet document for floating the data object on the spreadsheet document.

[0012] Fig. 3 A illustrates pulling or moving the data object of Fig. 2B for inserting or pushing the data object into a grid-structured spreadsheet document.

[0013] Fig. 3B illustrates inserting or pushing the data object of Fig. 3A into a grid- structured spreadsheet document.

[0014] Fig. 4A illustrates pulling or moving a data object from a grid-structured spreadsheet document for depositing the pulled or moved data object onto a canvas-like user interface.

[0015] Fig. 4B illustrates depositing the pulled or moved data object from Fig. 4A onto a canvas-like user interface.

[0016] Fig. 5 A illustrates pulling or moving a data object from a canvas-like user interface for depositing the pulled or moved data object onto a grid-structured spreadsheet document or for inserting or pushing the data object into a grid-structured spreadsheet document.

[0017] Fig. 5B illustrates depositing the data object of Fig. 5 A onto a grid-structured spreadsheet document or inserting or pushing the data object of 5A into a grid-structured spreadsheet object

[0018] Fig. 6 is a flowchart illustrating a method of seamless grid and canvas integration in a spreadsheet application. [0019] Fig. 7 is a block diagram illustrating example physical components of a computing device with which embodiments of the invention may be practiced.

[0020] Figs. 8A and 8B are simplified block diagrams of a mobile computing device with which embodiments of the present invention may be practiced.

[0021] Fig. 9 is a simplified block diagram of a distributed computing system in which embodiments of the present invention may be practiced.

DETAILED DESCRIPTION

[0022] As briefly described above, embodiments of the present invention are directed to seamless grid and canvas integration and spreadsheet application. The following detailed description refers to the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the following description to refer to the same or similar elements. While embodiments of the invention may be described, modifications, adaptations, and other implementations are possible. For example, substitutions, additions, or modifications may be made to the elements illustrated in the drawings, and the methods described may be modified by substituting, reordering, or adding stages to the disclosed methods. Accordingly, the following detailed description does not limit the invention but, instead, the proper scope of the invention is defined by the appended claims.

[0023] Fig. 1 illustrates a system architecture in which embodiments of the present invention may be practiced. In Fig. 1, a variety of computing devices are illustrated with which embodiments of the present invention may be practiced on individual computing devices or in a collaborative work session. For example, a small-form smartphone or other handheld computing device 110 is illustrated having a display surface 111 and being associated with a spreadsheet application 115. A larger form tablet-style computing device 105 having a display surface 106 and an associated spreadsheet application 115 is illustrated. A large display device 120 having a display surface 121 is illustrated being associated with a computer 125 and a spreadsheet application 115.

[0024] As should be appreciated, the computing devices 105, 110, 120, 125 are purposes of illustration only and are not exhaustive of the various types of computing devices that may be used in accordance with embodiments of the present invention. For example, while the display device 120 is illustrated as a display unit with an associated computing device 125, the large-form display device 120 may operate as an integrated display/computing device that may be used for any suitable use from large-scale display uses, for example, in a conference room, to personal computing, as desired. According to embodiments, each of the computing devices illustrated in Fig. 1 may receive input through a variety of suitable means including touch or gesture input, keyboard input, mouse input, voice command input, electronic inking input, and the like.

[0025] Referring still to Fig. 1, the software applications 115 illustrated in association with each of the computing devices 105, 110, 120, 125 are illustrative of any of a spreadsheet application having sufficient computer executable instructions for enabling embodiments of the present invention as described herein. An example spreadsheet application 115 includes EXCEL manufactured by Microsoft Corporation of Redmond, Washington. As should be appreciated, this is but one example spreadsheet application 115, and any other application suitable for enabling embodiments described herein may be used.

[0026] Each of the computing devices 105, 110, 120, 125 may operate in a collaborative work environment through one or more wired or wireless data connections 145, 150, 155. That is, each of the computing devices may communicate with each other through wired or wireless data lines via direct connection, or via connection through a distributed computing network 130 such as an Internet or intranet.

[0027] According to embodiments, application functionality associated with each of the computing devices 105, 110, 120, 125 may operate according to one or more variations. For example, each application 115 may be a fully functional "thick" client application having all application functionality including the ability to send and receive data to and from other applications 115 operating on other computing devices in the collaborative work session. Each such application not only has its native functionality, for example, spreadsheet functionality, but according to embodiments of the present invention, each such application also contains sufficient computer executable instructions for allowing each application to operate as a control application for controlling information sent from a control device for receipt by an endpoint display device in a collaborative work environment. Likewise, each such application has sufficient computer executable instructions for allowing the application to operate as an endpoint display device for receiving control functions from another computing device.

[0028] According to another embodiment, the computing devices 105, 110, 120, 125 may communicate via a distributed computing network 130, for example, the Internet. Referring still to Fig. 1, the computing device 135 is illustrative of an Internet-based or "cloud-based" server computer on which may be operated one or more web services applications 140 for providing a collaborative work session, as described herein. According to this embodiment, each of the devices 105, 110, 120, 125 may operate as thin client systems, and collaborative communication between the devices may be operated at the direction of the web services application 140 operated at a remote site. According to this embodiment, a spreadsheet application 115 may operate at the remote server 135 wherein each of the devices 105, 110, 120, 125 may access and receive the functionality described herein via a remote service from the server based application 115, for example, via the web services application 140.

[0029) Figs. 2A, 2B, 3A, 3B, 4A, 4B, 5A, 5B described below show example spreadsheet application user interfaces with which data may be utilized, as described herein. As should be appreciated, the example user interfaces described below may be displayed on any suitable computing device 105, 110, 120,125 described above with reference to Fig. 1. In addition, as should be appreciated, user interaction with the described user interfaces may be performed according to any suitable interaction means, including touch interaction, gesture interaction, keyboard interaction, mouse interaction, voice command interaction, or a combinations thereof.

[0030] Fig. 2A illustrates pulling or moving a data object from a grid-structured spreadsheet document for floating the pulled data object on to the spreadsheet document from which it was pulled. A spreadsheet application user interface 205 is illustrated having a variety of application functionality buttons and/or controls 215, 216 for providing functionality in association with the grid-structured spreadsheet document 210 and one or more data objects 220, 225, 230, 235, 245 entered therein by one or more users. A ''Sheet 1" indicator 250 and a "Sheet 2" indicator 255 are illustrative of indicators showing that the example spreadsheet application document is comprised of two sheets of grid- structured data. The grid-structured sheets comprised of various rows and columns which combine to form an array of cells is well known to those skilled in the art and is illustrative of a user interface layout for receiving data of various types and for organizing, manipulating, and performing various computational functions on data according to any suitable spreadsheet application 115 described above with reference to Fig. 1.

[0031] According to embodiments of the present invention, one or more data objects, including data objects, for example, tables, charts, pivot tables, cells, ranges of cells, named ranges of cells, pivot charts, and the like may be pulled, copied or moved from a spreadsheet document (e.g., sheet) and may be deposited onto the same or another spreadsheet document such that the data objects "float" on top of the grid-structured spreadsheet document. That is, as illustrated in Fig. 2A, a user 260 using a pinching-style touch gesture may pull the data object 230 (e.g., data table) from the grid-structured spreadsheet 210 to allow the pulled data object to float on top of the grid-structured spreadsheet document 210, as illustrated in Fig. 2B.

[0032] While the pulling of the data object 230 is illustrated as a touch gesture (e.g., pinching and pulling) user interaction, any other appropriate function for pulling and moving the data, for example, cut and paste, drag and drop, and the like may be utilized for pulling and moving a data object from the grid-structured spreadsheet 210 and for floating the data object on to the grid-structured spreadsheet 210, or for pushing the data object back into a grid-structured spreadsheet 210, or placing the data object onto a spreadsheet canvas, as described below.

[0033] Referring to Fig. 2B, the now floating data object 230 (e.g., data table) may be moved about on the surface of the grid-structured spreadsheet 210 as desired by the user. For example, as illustrated in Fig. 2B, the floating data object 230 is partially covering column B in the spreadsheet 210 such that part of the data entered into column B, rows 3 and 4 is covered by the floating data object 230. As should be appreciated, according to embodiments of the present invention, the user may move the floating data object 230 around the grid-structured spreadsheet as desired. For example, if the object 230 previously was positioned in the spreadsheet at a considerable distance from column A such that the user was not able to view the data contained in column A and the data contained in the table data object 230 simultaneously owing to a lack of sufficient display space on the user's computing device 105, 110, 120,125 then according to embodiments of the present invention, the user may pull the table data object 230 from the grid-structured spreadsheet 210 to allow the table data object 230 to float on top of the spreadsheet, followed by moving the floating table object to a position, as illustrated in Fig. 2B, where the user may visualize the data contained in column A and contained in the floating table object simultaneously. Thus, the user has immediately overcome the space limitations placed on the user by the size of his/her display screen so that the user may readily and efficiently view the desired column of data and the floating data table side-by-side. As should be appreciated, this is but one example of the benefits of enabling the floating of a given data object on the grid-structured spreadsheet, as desired.

[0034] A floating data object may be authored, edited, or updated (e.g., have formulas adjusted or have data/images/etc. changed) just as if it were still in a fixed position in the grid-structured spreadsheet. For example, the floating data object may be edited directly by the user, updated when the spreadsheet recalculates, updated in response to changes made in other places in spreadsheet by the user, or other events that impact the data object. In other words, the floating data object remains connected to the data/computational model of the spreadsheet.

[0035] As should be appreciated, the illustration of a floating table data object 230 is for purposes of example only. As described above, any data object, for example, a cell, a range of cells, a chart, a pivot table, and the like may be pulled from the grid-structured spreadsheet and may be floated on top of the grid-structured spreadsheet followed by moving the floating object around on the spreadsheet for the benefit of the user 260.

[0036] Referring now to Fig. 3A, according to embodiments of the present invention, a floating data object 230 may be pushed back into the grid-structured spreadsheet 210 at any position such that the re-inserted data object may once again be part of the spreadsheet 210 so that the re-inserted data object 230 moves with and adjusts with and is otherwise associated with the structure of the spreadsheet 210 in terms of positioning in appropriate rows and columns in the spreadsheet 210 in which it is inserted. As illustrated in Fig. 3B, the data object 230 that is pushed into the grid-structured spreadsheet 210 does not have to be pushed or re-inserted into the spreadsheet 210 in the same location from which it was originally removed. Referring back to Fig. 2A, the data object 230 was originally positioned at columns D and E, rows 2, 3, and 4, but as illustrated in Fig. 3B, the data object 230 has been re-inserted into the spreadsheet 210 at a different position at columns B and C, rows 2, 3, and 4.

[0037] Moreover, the data object 230 need not only be re-inserted back into the spreadsheet 210 from which it came, but instead the floating data object 230 may be pushed into the a different sheet of the present spreadsheet application document (e.g., spreadsheet workbook), or the floating data object 230 may be pushed into a sheet of a different spreadsheet application document (e.g., workbook) altogether. In addition, it is not required that the sequence go from pulling the data object from one spreadsheet, floating the data object onto the same or different sheet, followed by pushing or inserting the floating data object 230 into the same or other different sheet. According to embodiments, a user may pull a data object directly from one sheet and immediately insert the data object to a different location in the same sheet or to a desired location in a different sheet.

[0038] Referring now to Fig. 4A, according to another embodiment of the present invention, a canvas-like user interface may be created within a spreadsheet application that allows for a free flowing arrangement of spreadsheet-like objects, for example, tables, charts, pivot tables, cells, ranges of cells, named ranges of cells, pivot charts, and the like. Such spreadsheet-like objects may be placed onto the grid-less canvas-like user interface by pulling the objects from the grid-structured spreadsheet 210 followed by placement of the pulled or extracted objects onto the canvas, as illustrated in Fig. 4B. Each canvas may be treated as an individual document that may be displayed, printed, transmitted and otherwise utilized, or one or more canvases and one or more grid-structured spreadsheets (sheets) may be combined to form a spreadsheet document. Spreadsheet-like objects may also be natively created on the canvas as well. In other words, the objects do not need to be created in and extracted from the grid-structured spreadsheet 210 in order to be placed on the canvas. This allows users to accomplish a significant portion of their work with minimal use of the grids in the grid-structured spreadsheet 210, if desired.

[0039] Referring still to Figs. 4A and 4B, a user first selects a "Create Canvas" function 410 for generating the canvas-like user interface 420 illustrated in Fig. 4B. As should be appreciated, the "Create Canvas" function 410 is illustrated for purposes of example only and is not exhaustive of the various means by which a spreadsheet application may enable the creation of a grid-less canvas-like user interface 420, as illustrated in Fig. 4B. The canvas-like user interface has no grid-structured spreadsheet 210, as illustrated above with reference to Figs. 2A through 4A, meaning that no designated rows and columns and resulting array of cells are displayed in the canvas-like user interface 420. According to embodiments, data objects 230, 425, 430 disposed on the canvas-like user interface 420 may be moved around at the will and desire of the user in a free flowing manner without regard to specific location, for example, without regard to particular cells or array of cells as is typical for a grid-structured spreadsheet 210, as illustrated in Figs. 2 A through 4A. Thus, with the canvas-like user interface 420, a user may create a presentation, document, and the like having spreadsheet-like data objects, data objects, images, or other content disposed on the canvas-like user interface 420, and the user is free to move each of the disposed objects around, as desired.

[0040] For example, as illustrated in Fig. 4B, the user has generated a canvas-like worksheet wherein the user has disposed a first data object 230 (e.g., a table), a second data object 430 (e.g., a table), and an image data object 425. For example, the user may desire to create a document for presentation at a meeting having spreadsheet-like objects, (e.g., table data objects 230, 430), as well as, one or more image data objects 425 without having the clutter or visual distraction often associated with a grid-structured spreadsheet 210 having distinct columns and rows and separator lines forming individual cells. [0041] Referring still to Fig. 4B, the two table data objects 230, 430 may be illustrative of data objects or portions of data extracted from a single spreadsheet, or each of the data objects 230, 430 may have been extracted from each of two separate spreadsheets from one spreadsheet application workbook or from two different spreadsheet application workbooks. That is, according to embodiments of the present invention, spreadsheet-like objects, such as the table data objects 230, 430, may be populated onto the canvas-like user interface 420 from one or more different spreadsheet sources. In addition, other data objects, for example, the image 425 may be populated onto the canvas-like user interface 420 from various other sources, for example, photographic libraries, clipart libraries, word processing application documents, slide presentation application documents, and the like.

[0042] As illustrated at the bottom of the user interface 420, two sheet designators 435, 440 are illustrated for showing that two spreadsheet application sheets are associated with the canvas-like user interface 420 from which the table data objects 230, 430 may have been extracted. That is, the associated spreadsheet workbook may include two sheets indicated by the sheet indicators 435, 440, and when the canvas interface is generated, then available sheets of the workbook may be identified in association with the canvas (i.e., canvas-like user interface). For example, if the user desires additional information from a spreadsheet application sheet associated with the sheet indicator 435, the user may select the indicator 435 for launching an instance of the associated sheet or for navigating to the associated sheet for extracting additional data objects or data items for placement on the canvas-like user interface 420.

[0043] In addition, the one or more spreadsheet application sheets may be treated as individual objects that may be disposed on the given canvas-like user interface 420. For example, if a first sheet 435 includes columns A through E and rows 1 through 10 as a first sheet, and if a second sheet 440 includes columns A through C and rows 1 through 5, each of the sheets, while traditional sheets in an associated spreadsheet application workbook, may be treated as individual objects that may be disposed in their entireties or in portions on the canvas-like user interface 420. Thus, according to embodiments, one or more grids (or portions of one or more grids from a grid-structured spreadsheet 210) may be disposed as data objects on the canvas-like user interface.

[0044] Referring back to Fig. 4A, the user 260 may pull a data item or data object, for example, the table data object 230, from the grid-structured spreadsheet 210, followed by dropping the pulled data object 230 onto the canvas-like user interface 420, as illustrated in Fig. 4B. That is, as described above with reference to Figs. 2A and 2B, just as the user may pull a data object from one grid-structured spreadsheet 210 and drop the data object as a floating data object onto the same or different grid-structured spreadsheet 210, so may the user pull a data object 230 from the grid-structured spreadsheet 210 and drop the pulled data object as a floating data object onto the canvas-like user interface 420, as illustrated in Fig. 4B. Accordingly, each data object, content item, image, and the like disposed on the canvas-like user interface 420 may be in the form of a floating object that may be moved around on the user interface 420 by the user for generating a desired layout.

[0045] Referring now to Figs. 5A and 5B, a data object 230 that has been disposed onto a canvas-like user interface 420 may be moved from the canvas 420 back onto a grid- structured spreadsheet 210, as illustrated in Fig. 5B by one of a variety of suitable means, including touch (pinching move), gesture, keyboard entry, mouse entry, voice command, or a combination thereof. In addition, movement of a data object 230 from the canvas 420 back onto the grid-structured spreadsheet 210 may be performed according to different functions, for example, cut and paste, drag and drop, and the like.

[0046] As described above with reference to Figs. 2A, 2B, 3 A and 3B, when a data object 230 is moved from the canvas-like user interface 420 to the grid-structured spreadsheet 210, as illustrated in Fig. 5B, the moved data object 230 may be dropped onto the grid-structured spreadsheet 210 as a floating data object which may be moved around on the grid-structured spreadsheet 210, as illustrated and described above with reference to Fig. 2B. Alternatively, the data object pulled from the canvas-like user interface 420 may be pushed or inserted into the grid-structured spreadsheet 210 at a desired location, as illustrated and described above with reference to Fig. 3B. Alternatively, a data object 230 pulled from the canvas-like user interface 420 may be dropped onto a second canvas-like user interface 420, as illustrated and described above with reference to Fig. 4B.

[0047] Referring back to Figs. 2B, 3B and 5B, according to embodiments, lines separating columns and rows may be used as guide lines and snap lines for assisting a user in positioning a floating data object or in inserting a data object into a grid-structured spreadsheet. Referring to Fig. 2B, the data object 230 is illustrated as a floating object on the sheet 210. The grid lines (for example, grid lines 246, 247 separating rows 2 and 3 and columns A and B, respectively) may be used as guide lines for moving or aligning the floating object into a particular position on the sheet 210, or for inserting the object into a particular position. According to one embodiment, as the data object is moved toward one or more grid lines 246 and 247, the grid lines may serve as "snap" lines wherein, when the moved data object gets within a predetermined distance from the lines, the data object is "snapped" into position such that the guide lines or snap lines automatically become bordering lines for the data object. According to another embodiment, if the cell size of cells located in a position to which the data object is moved are different from the cell sizes of the pulled and moved data object, the data object may be automatically resized to match the cell sizes of the point at which the data object is deposited or inserted.

[0048] According to embodiments, one or more grid-structured spreadsheets (sheet) and one or more canvas-like user interfaces (canvas) may be combined together to form a single spreadsheet document (also known as a "workbook"), and a user may freely navigate between any of the canvases and sheets as desired. In addition, data objects may be moved between each of the sheets or canvases interchangeably as described herein. In addition, individual sheets and/or canvases may be shared, published, or otherwise utilized between a plurality of computing devices 105, 110, 120, 125,135 from device-to-device directly or via a distributed computing network via a server-based system, as described above with reference to Fig. 1. That is, all functionality typically associated with a spreadsheet application sheet or workbook may be utilized for the canvas-like user interfaces 420, for example, sharing, enabling collaboration, publishing, viewing via web service applications 140, and the like.

[0049] According to embodiments, when a data object is moved from a grid-structured spreadsheet 210 associated with a traditional spreadsheet application sheet to another grid- structured spreadsheet, or when a data object is moved from a grid-structured spreadsheet 210 to a canvas-like user interface 420, a moved, floating, or subsequently inserted (in a case of insertion of a data object into a grid-structured) object may maintain relationships including computational relationships back to the original grid-structured spreadsheet 210 from which the object was extracted. According to embodiments, and as will be described in further detail below, the ability to pull a data item, collection of data items, or data object from the grid-structured spreadsheet 210 to allow the pulled data to float on the same or different spreadsheet is enabled by changing the direct dependencies of pulled data items to particular grid-structured cells and by supporting structured references between pulled data items and the grid-structured spreadsheet 210 from which they are pulled. In other words, a data item may be disconnected from the data/computational model of the spreadsheet causing the data item to no be updated. Although no longer participating in calculations or other updates, the data item may still shows the last value. In various embodiments, the dependencies of the data item remain as structured references. [0050] Such data and computational relation back to the original grid-structure may be accomplished through use of structured references between components of moved data objects and the original grid-structured spreadsheet 210. For example, referring back to Figs. 2A and 2B, prior to pulling the data object 230 from the grid-structured spreadsheet 210, the table data object 230 consisted of two columns and three rows of data positioned in columns D and E and rows 2, 3, and 4. According to the example table data object 230, the "Orders" data at position D3 corresponds to the "Sales" data at position E3. And, as should be appreciated, the "Sales" data at position E3 may be the result of a computational function, for example, multiplying the "Orders" value at position D3 against a price per order found in another location in the grid-structured sheet 210. According to embodiments, when the table data object 230 is pulled from the grid-structured sheet 210 and is dropped onto the grid-structured sheet 210 as a floating object, as illustrated in Fig. 2B, or when the object is dropped onto the canvas-like user interface 420, as illustrated in Fig. 4B, the individual data items contained in the pulled data object 230, along with computational functions and relationships of the data items contained in the data object 230 are maintained. Thus, as illustrated in Figs. 2B and 4B, when the data objects are dropped onto the grid-structured spreadsheet 210 or onto the canvas-like user interface 420, the data contained in the data object and the computational relationships between the data contained in the data object 230 are maintained.

[0051] For example, after the data object 230 is dropped onto the grid-structured spreadsheet 210 or onto the canvas-like user interface 420, if the user changes a data item, for example, the "Orders" data item of 32 orders, a "Sales" figure associated with the 32 order items will automatically change owing to the computational function associated with the cell containing the sales figure and the maintenance of its relationship with the associated orders cell. According to embodiments, the maintenance of relationships between data and computational functions contained in or associated with the moved data object back to corresponding data and computational functions contained in or associated with the grid-structured sheet from which the data object was pulled or moved is accomplished via structured references between data items and computational functions contained in the moved data object back to corresponding data and computational functions contained in or associated with the grid-structured sheet. That is, while the data item of 32 orders originally contained at position D3 in the example sheet, illustrated in Fig. 2A, may be moved to a floating position, as illustrated in Fig. 2B, or may be reinserted into a different location in the sheet, as illustrated in Fig. 3B, or may be dropped onto a canvas-like user interface 420, as illustrated in Fig. 4B, the data contained in a given cell, for example, the data item of 32 orders originating at cell position D3 is not referenced back to the particular cell position D3, but instead is referenced to the data or computational function originally contained at that position through a structured reference, because, as illustrated in Fig. 3B, the original data and associated computational functions for a sheet into which a data object is inserted or onto which another data object is moved may be different from the original grid-structured sheet from which the data object was originally pulled or moved.

[0052] According to a structured references relationship between a pulled and moved data object back to the original grid-structured spreadsheet from which it was received, data and computational functions in or associated with the pulled and moved data object must be referenced back to corresponding data and computational functions without relating back to specific cell locations. For example, referring back to Figs. 2A and 3B, data contained at cell positions D3 and D4 are moved with the table data object 230 and are reinserted into the sheet 210 such that the corresponding data in the moved table data object 230 is now positioned at cell positions B3 and B4, respectively. However, because the table data object 230 was re-inserted into a position between the columns of data that originally were positioned in columns A and B, the data 225 that was originally positioned in column B is now positioned in column D such that new data items are positioned at cell positions D3 and D4, respectively. Thus, if the cells contained in the moved data object 230 are referenced back to the original cells on a cell-to-cell basis, then the computational functionality (e.g., calculation of sales data as a function of orders data) would generate an erroneous outcome, because data in the original cells D3 and D4 has been changed owing to the insertion of the moved table data object 230 into a position in columns B and C.

[0053] This is particularly important for avoiding collisions between a moved and possibly modified data object whether the object is reinserted or not. For example, referring still to Fig. 3B, without the structured references relationship, if the original data in columns A and B represent a pivot table or other complex spreadsheet function, inserting the data object 230 likely would cause a collision with the functioning of the pivot table. For another example, if a data object is pulled having two rows of data, but is modified to add another row of data before it is reinserted back into the same spreadsheet, the expansion of the data object may cause a collision with another object, for example, a pivot table positioned immediately beneath the originally pulled data object. However, by replacing cell references in the pulled data object with structured references to the underlying data and/or functionality, then the pulled data object may be modified and/or re-inserted without creating an error condition for other data objects in the spreadsheet.

[0054] According to embodiments of the present invention, data relationships and computational function relationships between moved data objects and corresponding data and computational functions contained in or associated with the original sheet from which the data objects are extracted are maintained through structured references, wherein data and computational functions contained in a moved data object are referenced back to the correct corresponding data and computational functions regardless of where the corresponding data items and computational functions are moved in the original grid- structured spreadsheet. According to one embodiment, these structured references are created and maintained through an abstraction layer built for all data items or data objects in a spreadsheet in a way that allows each data item or data object to abstract a cell location and/or cell behavior (e.g., computational function). Thus, each data item or data object may index data and computational functions contained therein and map the data items and computational functions contained therein to the corresponding data items and computational functions contained in the grid-structured spreadsheet from which the data items or data objects are extracted. Regardless of where a particular data object is moved, for example, to another grid-structured spreadsheet, or to a canvas-like user interface 420, each data item and/or computational function may be mapped back to the appropriate data item and/or computational function in the grid-structured spreadsheet from which it was extracted and referenced by other data objects and items. For example, if cell D4 is extracted from the grid-structured spreadsheet and made into a floating data object, another cell that references cell D4 would be updated to reference the floating data object using the structured reference. Thus, a formula such as SUM(C3, D4) would be updated to replace D4 with the structured reference (e.g., myFloatingRange.[0][4]).

[0055] When a data object 230 is moved, as described above, then the object may communicate with the original grid-structured spreadsheet and other data objects via the abstraction layer, as required. According to embodiments, syntax associated with such structured references points data items and/or computational functions contained in a moved data object to indexed associated data and/or computational functions without the need of pointing directly to a particular cell location for finding required data and/or computational functions. According to one embodiment, a naming construct may be utilized wherein each data object 230 moved from a given grid-structured sheet to another sheet or canvas-like user interface, or vice versa, may be assigned a name or other identification to allow all other data items and/or data objects in a spreadsheet to reference the named object via its name or other identification so that structured referencing syntax may be used for accessing local items in one or more grid-structured sheets (e.g., cells, ranges of cells, data objects, etc.) or any desired spreadsheet application operation or function including local or global calculation change, and the like.

[0056] Referring still to Figs. 2A through 5B, a "Structured References" button 216 is illustrated in the user interface 205 for creating and utilizing structured references between data objects and grid-structured spreadsheets, as described above. As should be appreciated, the button 216 is for purposes of illustration only and is not exhaustive of the various ways in which structured reference functionality may be applied to one or more data objects. For example, the user interface 205 may provide for functionaUty for allowing the user to convert an object from spreadsheet cell references to structured references, as described above. For example, upon selection of a given data object 230, before moving the data object 230 to a different location, a user may select a functionality provided via the user interface 205 for manually converting cell references to structured references so that a cell contained in a moved data object no longer references a particular cell or cells contained in the original grid-structured sheet location, but instead, references the data and/or computational functions associated therein through structured references, as described above. Alternatively, the conversion of spreadsheet cell references to structured references may occur automatically when a data item or object is pulled from the grid-structured sheet, as described above.

[0057] According to one embodiment, a default choice may be provided to a user that may change dynamically based on an object type or a number of computational functions (e.g., formulas associated with a given data item or object). For example, when a user pulls a particular data object from a grid-structured sheet, the associated cell references may be automatically converted to structured references, as described above, but when a moved data object is pushed into or dropped onto a grid-structured spreadsheet, as illustrated above with reference to Fig. 3B, then the structured references may not be converted back to cell references so that references between data items and computational functions back to the grid-structured sheet are maintained, as described above.

[0058] According to another embodiment, in some cases, references between a moved data object and the original grid-structured spreadsheet from which the data object was extracted may be disconnected such that the data items and any computational functions associated with the moved object will continue to work relative to each other, but such that changes in the original grid-structured sheet will not be reflected in the moved object. Thus, a user interface function may be provided for allowing a user to manually disconnect references between an object to be moved before the object is moved so that the object may be a freestanding data object in the new location. For example, if a user desires to create a presentation using the canvas-like user interface 420, illustrated above with reference to Figs. 4B and 5A, the user may wish to disconnect the moved object from the original grid-structured sheet from which it is extracted so that if any associated data or computational functions contained in the original grid-structured sheet are subsequently changed, the object placed on the canvas-like user interface 420 for the user's presentation will not be dynamically changed which may upset the purpose of the presentation being created by moving the example data object to the canvas.

[0059] Having described an exemplary operating environment and various aspects of embodiments to the present invention with reference to Figs. 1 through 5B, Fig. 6 is a flowchart illustrating a method of seamless grid and canvas integration in a spreadsheet application. The method 600 begins at operation 60S and moves to operation 610 where a spreadsheet document (e.g., spreadsheet workbook) containing one or more grid- structured sheets 210 is opened for use. At operation 615, a user decides to pull a data object 230, for example, an individual cell, a range of cells, a table, a chart, a pivot table, a named range of cells, a pivot chart, or the like from an available spreadsheets 210 for deposit onto a spreadsheet as a floating object, for insertion into a spreadsheet as an inserted object, or for deposit onto a canvas-like user interface 420, as described above.

[0060] At operation 620, the pulled data object may be named or otherwise identified so that data and/or computational functions in or associated with the pulled data object may be referenced back to the other data and other computational functions contained in the spreadsheet from which the data object was pulled. At operation 625, an abstraction layer for allowing communication between the pulled object and the spreadsheet from which the object was pulled is built.

[0061] At operation 630, cell references are converted to structured references, as described above, for allowing communication between the pulled object and associated cells and/or computational functions via the abstraction layer. As described above, if desired, references between data items and computational functions contained in the pulled data object may be selectively disconnected or broken to allow the pulled object to operate as a free standing data object in a subsequent location. [0062] At operation 633, the pulled object may be floated onto the same or another grid- structured spreadsheet and may be moved by the user to various positions on the spreadsheet, as described above with reference to Fig. 2B. The pulled object subsequently may be pushed back into the original spreadsheet or to another spreadsheet at operation 635, as desired.

[0063] Alternatively, at operation 635, instead of floating the pulled object, it may be pushed into the grid-structured spreadsheet from which it was extracted at any location desired by the user, or the pulled data object may be pushed into the grid of a different spreadsheet.

[0064] Alternatively, at operation 640, the user may selective create a canvas-like user interface 420, as described above with reference to Fig. 4A and 4B, and at operation 645, the pulled object may be dropped onto the canvas and may be moved about on the canvas, as desired.

[0065] At operation 650, any functionality available from the spreadsheet application for operating on data objects contained in or associated with the canvas-like user interface 420 may be enabled.

[0066] As described above, after any of the operations 633, 635 or 645, any or all of the moved data items or data objects may be extracted from their deposited locations and may be moved to other locations in other grid-structured spreadsheets or other canvas-like user interfaces, as desired. In addition, data objects pulled from a given spreadsheet or canvaslike user interface may be shared with or sent to other users for any suitable use, including for use in accordance with embodiments of the present invention with other spreadsheet application worksheets and canvases, as described herein.

[0067] While the invention has been described in the general context of program modules that execute in conjunction with an application program that runs on an operating system on a computer, those skilled in the art will recognize that the invention may also be implemented in combination with other program modules. Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types.

[0068] The embodiments and functionalities described herein may operate via a multitude of computing systems including, without limitation, desktop computer systems, wired and wireless computing systems, mobile computing systems (e.g., mobile telephones, netbooks, tablet or slate type computers, notebook computers, and laptop computers), hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, and main ame computers.

[0069] In addition, the embodiments and functionalities described herein may operate over distributed systems (e.g., cloud-based computing systems), where application functionality, memory, data storage and retrieval and various processing functions may be operated remotely from each other over a distributed computing network, such as the Internet or an intranet. User interfaces and information of various types may be displayed via on-board computing device displays or via remote display units associated with one or more computing devices. For example user interfaces and information of various types may be displayed and interacted with on a wall surface onto which user interfaces and information of various types are projected. Interaction with the multitude of computing systems with which embodiments of the invention may be practiced include, keystroke entry, touch screen entry, voice or other audio entry, gesture entry where an associated computing device is equipped with detection (e.g., camera) functionality for capturing and interpreting user gestures for controlling the functionality of the computing device, and the like.

[0070] Figs. 7-9 and the associated descriptions provide a discussion of a variety of operating environments in which embodiments of the invention may be practiced. However, the devices and systems illustrated and discussed with respect to Figs. 7-9 are for purposes of example and illustration and are not limiting of a vast number of computing device configurations that may be utilized for practicing embodiments of the invention, described herein.

[0071] Fig. 7 is a block diagram illustrating physical components (i.e., hardware) of a computing device 700 with which embodiments of the invention may be practiced. The computing device components described below may be suitable for the computing devices 105, 110, 120, 125, 135 described above. In a basic configuration, the computing device 700 may include at least one processing unit 702 and a system memory 704. Depending on the configuration and type of computing device, the system memory 704 may comprise, but is not limited to, volatile storage (e.g., random access memory), non-volatile storage (e.g., read-only memory), flash memory, or any combination of such memories. The system memory 704 may include an operating system 705 and one or more program modules 706 suitable for running a variety of applications 720. The operating system 705, for example, may be suitable for controlling the operation of the computing device 700. Furthermore, embodiments of the invention may be practiced in conjunction with a graphics library, other operating systems, or any other application program and is not limited to any particular application or system. This basic configuration is illustrated in Fig. 7 by those components within a dashed line 708. The computing device 700 may have additional features or functionality. For example, the computing device 700 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in Fig. 7 by a removable storage device 709 and a non-removable storage device 710.

[0072] As stated above, a number of program modules and data files may be stored in the system memory 704. While executing on the processing unit 702, the program modules 706 may perform processes including, but not limited to, one or more of the stages of the method 600 illustrated in Figure 6. Other program modules that may be used in accordance with embodiments of the present invention may include applications, such as, spreadsheet applications, notes applications, Internet browser applications, electronic mail and contacts applications, word processing applications, database applications, slide presentation applications, drawing or computer-aided application programs, etc.

[0073] Furthermore, embodiments of the invention may be practiced in an electrical circuit comprising discrete electronic elements, packaged or integrated electronic chips containing logic gates, a circuit utilizing a microprocessor, or on a single chip containing electronic elements or microprocessors. For example, embodiments of the invention may be practiced via a system-on-a-chip (SOC) where each or many of the components illustrated in Fig. 7 may be integrated onto a single integrated circuit. Such an SOC device may include one or more processing units, graphics units, communications units, system virtualization units and various application functionality all of which are integrated (or "burned") onto the chip substrate as a single integrated circuit. When operating via an SOC, the functionality, described herein, with respect to use of web page content may be operated via application-specific logic integrated with other components of the computing device 700 on the single integrated circuit (chip). Embodiments of the invention may also be practiced using other technologies capable of performing logical operations such as, for example, AND, OR, and NOT, including but not limited to mechanical, optical, fiuidic, and quantum technologies. In addition, embodiments of the invention may be practiced within a general purpose computer or in any other circuits or systems.

[0074] The computing device 700 may also have one or more input device(s) 712 such as a keyboard, a mouse, a pen, a sound input device, a touch input device, etc. The output device(s) 714 such as a display, speakers, a printer, etc. may also be included. The aforementioned devices are examples and others may be used. The computing device 700 may include one or more communication connections 716 allowing communications with other computing devices 718. Examples of suitable communication connections 716 include, but are not limited to, RF transmitter, receiver, and/or transceiver circuitry; universal serial bus (USB), parallel, and/or serial ports.

[0075] The term computer readable media as used herein may include computer storage media. Computer storage media may include volatile and nonvolatile, removable and nonremovable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, or program modules. The system memory 704, the removable storage device 709, and the non-removable storage device 710 are all computer storage media examples (i.e., memory storage.) Computer storage media may include RAM, ROM, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other article of manufacture which can be used to store information and which can be accessed by the computing device 700. Any such computer storage media may be part of the computing device 700.

[0076] Figs. 8A and 8B illustrate a mobile computing device 800, for example, a mobile telephone 110, a smart phone 110, a tablet-style personal computer 105, a laptop computer, and the like, with which embodiments of the invention may be practiced. With reference to Fig. 8A, one embodiment of a mobile computing device 800 for implementing the embodiments is illustrated. In a basic configuration, the mobile computing device 800 is a handheld computer having both input elements and output elements. The mobile computing device 800 typically includes a display 805 and one or more input buttons 810 that allow the user to enter information into the mobile computing device 800. The display 805 of the mobile computing device 800 may also function as an input device (e.g., a touch screen display). If included, an optional side input element 815 allows further user input. The side input element 815 may be a rotary switch, a button, or any other type of manual input element In alternative embodiments, mobile computing device 800 may incorporate more or less input elements. For example, the display 805 may not be a touch screen in some embodiments. In yet another alternative embodiment, the mobile computing device 800 is a portable phone system, such as a cellular phone. The mobile computing device 800 may also include an optional keypad 835. Optional keypad 835 may be a physical keypad or a "soft" keypad generated on the touch screen display. In various embodiments, the output elements include the display 805 for showing a graphical user interface (GUI), a visual indicator 820 (e.g., a light emitting diode), and/or an audio transducer 825 (e.g., a speaker). In some embodiments, the mobile computing device 800 incorporates a vibration transducer for providing the user with tactile feedback. In yet another embodiment, the mobile computing device 800 incorporates input and/or output ports, such as an audio input (e.g., a microphone jack), an audio output (e.g., a headphone jack), and a video output (e.g., a HD 1 port) for sending signals to or receiving signals from an external device.

[0077] Fig. 8B is a block diagram illustrating the architecture of one embodiment of a mobile computing device. That is, the mobile computing device 800 can incorporate a system (i.e., an architecture) 802 to implement some embodiments. In one embodiment, the system 802 is implemented as a "smart phone" capable of running one or more applications (e.g., browser, e-mail, calendaring, contact managers, messaging clients, games, and media clients/players). In some embodiments, the system 802 is integrated as a computing device, such as an integrated personal digital assistant (PDA) and wireless phone.

[0078] One or more application programs may be loaded into the memory 862 and run on or in association with the operating system 864. Examples of the application programs include phone dialer applications, e-mail applications, personal information management (PIM) applications, word processing applications, spreadsheet applications, Internet browser applications, notes applications, messaging applications, and so forth. The system 802 also includes a non-volatile storage area 868 within the memory 862. The non-volatile storage area 868 may be used to store persistent information that should not be lost if the system 802 is powered down. The application programs may use and store information in the non-volatile storage area 868, such as e-mail or other messages used by an e-mail application, and the like. A synchronization application (not shown) also resides on the system 802 and is programmed to interact with a corresponding synchronization application resident on a host computer to keep the information stored in the non-volatile storage area 868 synchronized with corresponding information stored at the host computer. As should be appreciated, other applications may be loaded into the memory 862 and run on the mobile computing device 800.

[0079] The system 802 has a power supply 870, which may be implemented as one or more batteries. The power supply 870 might further include an external power source, such as an AC adapter or a powered docking cradle that supplements or recharges the batteries.

[0080] The system 802 may also include a radio 872 that performs the function of transmitting and receiving radio frequency communications. The radio 872 facilitates wireless connectivity between the system 802 and the "outside world", via a communications carrier or service provider. Transmissions to and from the radio 872 are conducted under control of the operating system 864. In other words, communications received by the radio 872 may be disseminated to the application programs via the operating system 864, and vice versa.

[0081] The visual indicator 820 may be used to provide visual notifications and/or an audio interface 874 may be used for producing audible notifications via the audio transducer 825. In the illustrated embodiment, the visual indicator 820 is a light emitting diode (LED) and the audio transducer 825 is a speaker. These devices may be directly coupled to the power supply 870 so that when activated, they remain on for a duration dictated by the notification mechanism even though the processor 860 and other components might shut down for conserving battery power. The LED may be programmed to remain on indefinitely until the user takes action to indicate the powered-on status of the device. The audio interface 874 is used to provide audible signals to and receive audible signals from the user. For example, in addition to being coupled to the audio transducer 825, the audio interface 874 may also be coupled to a microphone to receive audible input, such as to facilitate a telephone conversation. In accordance with embodiments of the present invention, the microphone may also serve as an audio sensor to facilitate control of notifications, as will be described below. The system 802 may further include a video interface 876 that enables an operation of an on-board camera 830 to record still images, video stream, and the like.

[0082] A mobile computing device 800 implementing the system 802 may have additional features or functionality. For example, the mobile computing device 800 may also include additional data storage devices (removable and/or non-removable) such as, magnetic disks, optical disks, or tape. Such additional storage is illustrated in Fig. 8B by the non-volatile storage area 868.

[0083] Data/information generated or captured by the mobile computing device 800 and stored via the system 802 may be stored locally on the mobile computing device 800, as described above, or the data may be stored on any number of storage media that may be accessed by the device via the radio 872 or via a wired connection between the mobile computing device 800 and a separate computing device associated with the mobile computing device 800, for example, a server computer in a distributed computing network, such as the Internet. As should be appreciated such data/information may be accessed via the mobile computing device 800 via the radio 872 or via a distributed computing network. Similarly, such data/information may be readily transferred between computing devices for storage and use according to well-known data/information transfer and storage means, including electronic mail and collaborative data/information sharing systems.

[0084] Fig. 9 illustrates one embodiment of the architecture of a system for providing web page content utilization seamless use of grid-structured and canvas-like spreadsheets, as described above. Content developed, interacted with, or edited in association with embodiments of the invention may be stored in different communication channels or other storage types. For example, various documents and stored content items may be stored using a directory service 922, a web portal 924, a mailbox service 926, an instant messaging store 928, or a social networking site 930. The grid-structured and canvas-like spreadsheets functionality described herein may use any of these types of systems or the like for enabling data utilization, as described herein. A server 135 may provide the grid- structured and canvas-like spreadsheet functionality to clients. As one example, the server 135 may be a web server providing the grid-structured and canvas-like spreadsheet functionality over the web. The server 135 may provide the output of the grid-structured and canvas-like spreadsheet functionality over the web to clients through a network 130. By way of example, the client computing device may be implemented and embodied in a personal computer 700, a tablet computing device 105 and or a mobile computing device 110 (e.g., a smart phone), or other computing device. Any of these embodiments of the client computing device 700, 105, 110, 120, 125 may obtain content from the store 916.

[0085] Embodiments of the present invention, for example, are described above with reference to block diagrams and/or operational illustrations of methods, systems, and computer program products according to embodiments of the invention. The functions/acts noted in the blocks may occur out of the order as shown in any flowchart. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.

[0086] The description and illustration of one or more embodiments provided in this application are not intended to limit or restrict the scope of the invention as claimed in any way. The embodiments, examples, and details provided in this application are considered sufficient to convey possession and enable others to make and use the best mode of claimed invention. The claimed invention should not be construed as being limited to any embodiment, example, or detail provided in this application. Regardless of whether shown and described in combination or separately, the various features (both structural and methodological) are intended to be selectively included or omitted to produce an embodiment with a particular set of features. Having been provided with the description and illustration of the present application, one skilled in the art may envision variations, modifications, and alternate embodiments falling within the spirit of the broader aspects of the general inventive concept embodied in this application that do not depart from the broader scope of the claimed invention.