Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
SELECTING CONTENT WITHIN A USER INTERFACE FOR EXTRACTION
Document Type and Number:
WIPO Patent Application WO/2012/012918
Kind Code:
A1
Abstract:
A system and method for selecting content from a graphical user interface of a physical computing system includes receiving, with the physical computing system, input from a user indicating a region within the graphical user interface; determining, with the physical computing system, at least one content object associated with the region of the graphical user interface; selecting, with the physical computing system, the at least one content object associated with the region if the at least one content object within the region is currently unselected; and unselecting, with said physical computing system, said at least one content object associated with said region if said at least one content object is currently selected. The graphical user interface differentiates, through display, between selected content objects and unselected content objects.

Inventors:
LIM SUKHWAN (US)
HOU HUIMAN (CN)
ZHENG LIWEI (CN)
JIN JIANMING (CN)
STRUCKMAN MARIE (US)
MUELLER RACHEL (US)
YUAN YUE (CN)
ZHANG HUA (CN)
Application Number:
PCT/CN2010/001159
Publication Date:
February 02, 2012
Filing Date:
July 30, 2010
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
HEWLETT PACKARD DEVELOPMENT CO (US)
LIM SUKHWAN (US)
HOU HUIMAN (CN)
ZHENG LIWEI (CN)
JIN JIANMING (CN)
STRUCKMAN MARIE (US)
MUELLER RACHEL (US)
YUAN YUE (CN)
ZHANG HUA (CN)
International Classes:
G06F17/30
Foreign References:
US20080040686A12008-02-14
US20060230055A12006-10-12
Attorney, Agent or Firm:
CHINA PATENT AGENT (H. K.) LTD. (Great Eagle Centre23 Harbour Road, Wanchai,Hong Kong Special Administrative Region, The People's Republic of China, CN)
Download PDF:
Claims:
CLAIMS

WHAT IS CLAIMED IS:

1. A method for selecting content from a graphical user interface for extraction, the method performed by a physical computing system comprising a processor, the method comprising:

receiving, with said physical computing system, input from a user indicating a region within said graphical user interface;

determining, with said physical computing system, at least one content object associated with said region of said graphical user interface; and performing at least one of:

selecting, with said physical computing system, said at least one content object associated with said region if said at least one content object within said region is currently unselected; and

unselecting, with said physical computing system, said at least one content object associated with said region if said at least one content object is currently selected;

in which said graphical user interface differentiates, through display, between selected content objects and unselected content objects.

2. The method of claim 1 , further comprising, sending said selected content objects to a printing device to be printed.

3. The method of claim 2, further comprising, when printing said selected content objects, doing at least one of: leaving blank spaces where said unselected content objects are located and removing spaces occupied by said unselected content objects.

4. The method of claim 1 , further comprising, transferring said selected content objects to a separate application for processing.

5. The method of claim 1 , in which said graphical user interface is a web browser and said content objects are web page content objects.

6. The method of claim 1 , further comprising, with said physical computing system, automatically determining whether content objects within a boxed region indicated by said user will become selected or unselected.

7. The method of claim 1 , in which said selected content objects and said unselected content objects of said graphical user interface are displayed with different shading.

8. The method of claim 1 , further comprising, with said physical computing system, coloring a region within a selection box manipulated by said user to indicate said region, said coloring based on whether said region includes at least one selected content object or at least one unselected content object.

9. The method of claim 1 , further comprising, with said physical computing system, causing a selection box displayed by said graphical user interface to snap to said at least one content object associated with said region indicated by said user.

10. The method of claim 8, further comprising, allowing said user to adjust a border of said selection box to one of: include an additional content object and exclude a selected content object.

11. The method of claim 1 , in which determining said at least one content object within said region comprises matching said at least one content object within said region with a Document Object Model (DOM) representing content objects of said graphical user interface.

12. A physical computing system comprising:

a processor; and a memory communicatively coupled to said processor;

said processor to:

receive input from a user indicating a region within said graphical user interface;

determine at least one content object associated with said region of said graphical user interface; and perform at least one of:

selecting said at least one content object associated with said region if said at least one content object within said region is currently unselected; and

unselecting said at least one content object associated with said region if said at least one content object is currently selected;

in which said graphical user interface differentiates, through display, between selected content objects and unselected content objects.

13. The system of claim 12, in which said processor is further to send said selected content objects to a printing device to be printed.

14. The system of claim 12, in which said processor is further to send said selected content to a separate application for processing.

15. The system of claim 12, in which said selected content objects and said unselected content objects of said graphical user interface are displayed with different shading.

16. The system of claim 12, in which said processor is further to color code a region within a selection box manipulated by said user to indicate said region, said color code based on whether said region includes at least one selected content object or at least one unselected content object.

17. The system of claim 12, in which said processor is further to cause a selection box displayed by said graphical user interface to snap to said at least one content object associated with said region indicated by said user.

18. The system of claim 18, in which said processor is further to allow said user to adjust a border of said selection box to one of: include an additional content object and exclude a selected content object.

19. A method for printing selected content from a graphical user interface of a physical computing system comprising a processor, the method comprising: receiving, with said physical computing system, input from a user indicating a region within said graphical user interface;

determining, with said physical computing system, at least one content object associated with said region of said graphical user interface;

selecting, with said physical computing system, said at least one content object associated with said region if said at least one content object within said region is currently unselected;

unselecting, with said physical computing system, said at least one content object associated with said region if said at least one content object is currently selected; and

sending, with said physical computing system, selected content objects of said graphical user interface to a printing device to be printed;

in which said graphical user interface differentiates, through display, between said selected content objects and unselected content objects.

Description:
SELECTING CONTENT WITHIN A USER INTERFACE FOR EXTRACTION

BACKGROUND

[0001] A wide variety of digital content is available to users through a variety of electronic devices. For example, users often browse digital content on their personal computers, mobile phones, and other types of computing systems. Graphical digital content is typically displayed to users through graphical user interfaces. Graphical content may include images, text, and other visual items. A graphical user interface allows a user to graphically interact with the displayed graphical content via a type of input device such as a mouse, trackpad, or touchscreen. A user is generally provided with a number of tools such as a cursor which can change its appearance based on actions being performed within the graphical user interface.

[0002] When graphical content is displayed to a user, it is often accompanied by a set of undesirable or irrelevant content. For example, when a user is browsing content on a web page through a web browser, it is often the case that the user must sort through advertisements and navigational objects to find the desired or relevant portion of the content presented. A user may desire to print a physical copy of content from a web page without reproducing any of the irrelevant content on the web page. Similarly, a user browsing a web page may wish to adapt content from the web page for use with another computer program, without including undesirable and irrelevant content from the web page. Such uses of only a portion of the content presented in a web page can require tedious effort on the part of a user to distinguish among the different types of content on the web page and retrieve only the desired content. BRIEF DESCRIPTION OF THE DRAWINGS

[0003] The accompanying drawings illustrate various embodiments of the principles described herein and are a part of the specification. The illustrated embodiments are merely examples and do not limit the scope of the claims.

[0004] Fig. 1 is a diagram showing an illustrative physical computing system, according to one example of principles described herein.

[0005] Fig. 2 is a diagram showing an illustrative graphical user interface, according to one example of principles described herein.

[0006] Fig. 3 is a diagram showing an illustrative graphical user interface differentiating between selected content objects and unselected content objects, according to one example of principles described herein.

[0007] Fig. 4 is a diagram showing an illustrative graphical user interface including a selection box, according to one example of principles described herein.

[0008] Fig. 5 is a diagram showing an illustrative graphic user interface displaying content to be selected and unselected, according to one example of principles described herein.

[0009] Fig. 6 is a diagram showing an illustrative graphic user interface with a snapping selection box, according to one example of principles described herein.

[0010] Figs. 7A and 7B illustrate possible printouts of selected content objects of a graphical user interface, according to one example of principles described herein.

[0011] Fig. 8 is a flowchart showing an illustrative method for selecting content within a user interface, according to one example of principles described herein.

[0012] Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements. DETAILED DESCRIPTION

[0013] As mentioned above, when graphical content is displayed to a user, it is often accompanied by a set of undesirable or irrelevant content. For example, when a user is browsing content on a web page through a web browser, it is often the case that the user must sort through advertisements and navigational objects to find the desired or relevant portion of the content presented. A user may desire to print a physical copy of content from a web page without reproducing any of the irrelevant content on the web page.

Similarly, a user browsing a web page may wish to adapt content from the web page for use with another computer program, without including undesirable and irrelevant content from the web page. Such uses of only a portion of the content presented in a web page can require tedious effort on the part of a user to distinguish among the different types of content on the web page and retrieve only the desired content.

[0014] In light of this and other issues, the present specification relates to methods and systems for providing a user with an intuitive means to select and unselect content to be extracted from a set of content objects on display via a graphical user interface.

[0015] According to certain illustrative examples, the physical computing system operating the graphical user interface displays a number of content objects. These content objects are categorized as either selected content objects or unselected content objects. Selected content objects are those that are extracted for use. Conversely, unselected content objects are those that are not be extracted for use. Uses for which content objects may be extracted may include, but are not limited to, printing and transferring to another application.

[0016] The physical computing system receives input from a user indicating a region within the graphical user interface. The physical computing system can then determine one or more content objects associated with that region. If any of those content objects are currently selected, then those content objects become unselected. If any of those content objects are currently unselected, then those content objects become selected. All content is displayed whether it is selected or unselected. However, the graphical user interface can differentiate, through display, between selected content and unselected content. For example, the shading of the selected content can be different than the shading of the unselected content.

[0017] Through use of methods and systems embodying principles described herein, a user is provided with an efficient and intuitive way to add and remove content which is selected for abstraction. By maintaining the display of all content, whether selected or unselected, the user can easily switch various content objects within the display between a selected and an unselected status. When the user is ready, he or she can execute the extraction process which extracts the selected content for whatever purpose the user desires.

[0018] In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough

understanding of the present systems and methods. It will be apparent, however, to one skilled in the art that the present apparatus, systems and methods may be practiced without these specific details. Reference in the specification to "an embodiment," "an example" or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment or example is included in at least that one embodiment, but not necessarily in other embodiments. The various instances of the phrase "in one embodiment" or similar phrases in various places in the specification are not necessarily all referring to the same embodiment.

[0019] Throughout this specification and in the appended claims, the term "selected content object" refers to a content object which is currently within a set of content objects selected for abstraction. The term "unselected content object" refers to a content object which is not within the set of content objects selected for extraction.

[0020] Referring now to the figures, Fig. 1 is a diagram showing an illustrative physical computing system. According to certain illustrative examples, the physical computing system includes a memory (102). The memory (102) includes content objects (104) to be displayed by a graphical user interface (110). The graphical user interface (1 10) is managed by graphical user interface software (108) being executed on a processor (108).

[0021] There are many types of memory ( 02) available. Some types of memory, such as hard disk drives, optical disc drives, and solid state drives, are designed for storage. These types of memory typically have large storage volume but relatively slow performance. Other types of memory, such as those used for Random Access Memory (RAM), are optimized for speed and are often referred to as "working memory." The various forms of memory may store information in the form of software and data.

[0022] The physical computing system (100) also includes a processor (108) for executing the software and using or updating the data in the memory ( 02). The physical computing system ( 00) may be embodied as a variety of physical computing devices including, but not limited to, a laptop or tablet computer, a desktop computer, and a Personal Digital Assistant (PDA) or mobile smart phone.

[0023] Various types of software may be utilized by the physical computing system (100). For example, one type of software which may be stored in memory (102) is content browsing software (106). The content browsing software (106) manages display content (104) and displays it to a user (112) via a graphical user interface (110).

[0024] Graphical digital content can be represented as content objects (104) by content browsing software (106). For example, a web browser can group content within a web page into modular blocks which are referred to as content objects (104). A content object may correspond to an image or a block of text. In one example, the text of an article can be divided into a number of objects, each object corresponding to one paragraph of text.

[0025] A graphical user interface (110) may provide a means for the user (112) to interact with the physical computing system (100). The graphical user interface (1 10) may include any collection of devices for interfacing with a human user (112). For example, the user interface (110) may include an output component such as a display device and input components such as a mouse or keyboard. Content objects may be displayed on the graphical user interface under the management of the content browsing software (106). Instructions from the user to the physical computing system (100) relating to interactions with the content objects ( 04) can be received through the input devices of the graphical user interface (110).

[0026] Fig. 2 is a diagram showing an illustrative graphical user interface (200). According to certain illustrative examples, the graphical user interface is a web browser displaying content of a web page. The content includes navigational content (204), advertisements (210), text objects (206), and image objects (208). The user may also be provided with a toolbar (202) which provides a number of tools for performing operations relating to the content browser.

[0027] Typical web pages include several content objects which are not relevant to a user when extracting content. For example, a typical web page includes navigational content (204) which provides the user with a way to navigate between different web pages. Although the navigational content (204) serves a purpose for the user, it is typically not desired to be extracted for printing or transferring content to another program. Additionally, web pages often include advertisements (210). Advertisements (210) are also typically not relevant to a user when extracting content for printing or transferring content to another program.

[0028] A web page often contains several text objects (206). As mentioned above, each text object may correspond to one paragraph of text. Various images may also be displayed on the web page. Some of these images may be useful to a user and some may not. For example, an image may be a pie graph or table relating to information in the text. This type of image may be useful to a user when extracting content for printing or transfer to another program.

[0029] Content objects of a web browser can be represented by a Document Object Model (DOM). A DOM is a cross-platform language used for representing and interacting with objects in common web development languages such as Hyper Text Markup Language (HTML) and extensible Markup Language (XML). The DOM for a set of content objects includes information relating to the regions within a display which is occupied by each content object. This information can be used to select content objects based on regions within the display indicated by a user.

[0030] Fig. 3 is a diagram showing an illustrative graphical user interface (300) differentiating between selected content objects and unselected content objects. According to one illustrative example, content objects which have been added to the set of content objects which are extracted can be displayed normally. These content objects are referred to as selected content objects (302).

[0031] Contents objects which have been removed by the user from the set of content objects to be extracted are given a darker shaded color.

These content objects are referred to as unselected content objects (304). With the selected contents (302) and the unselected contents (304) shaded differently, a user can better keep track of which content objects have been removed and which have been added to the set of selected content objects (302).

[0032] In the example illustrated in Fig. 3, text object 3 4 (206-4) and image object 1 (208-1) have been added to the set of selected content objects (302). The navigational content (204, advertisements (210), text object 1 (206- 1), text object 2 (206-2), text object 3 (206-3), and image object 2 (208-2) remain in the set of unselected content objects (304).

[0033] Fig. 4 is a diagram showing an illustrative graphical user interface (400) including a selection box (402). If a user desires to select additional content, he or she may indicate a region within the graphical user interface (400). The physical computing system operating the graphical user interface (400) can then determine the closest matching content object or group of objects indicated by the user.

[0034] According to one illustrative example, the user can indicate a region by drawing a selection box (402) around a desired region. The user does not have to draw the box precisely around the desired content object or group of content objects. The physical computing system can then compare the area of this region with the areas of each content object represented in the DOM. There may be many ways for the computing system to perform this matching process. Method for performing such matching would be apparent to one of skill in the art.

[0035] In the example illustrated in Fig. 4, the user draws a selection box (402) approximately around text object 2 (206-2) using a cursor (404). This indicates to the physical computing system that text object 2 (206-2) should be added to the set of selected content objects (302). Thus, Fig. 4 shows text object 2 (206-2) shaded as a selected content object (302).

[0036] Fig. 5 is a diagram showing an illustrative graphic user interface (500) displaying content to be selected and unselected. According to certain illustrative examples, a user draws a selection box (402) around a content object or group of objects by pressing and holding a button on an input device and dragging the cursor across the display to the opposite corner of the desired region. The user then releases the button on the input device. While the selection box (402) is being drawn, and before the user releases the button on the input device, the content objects currently within the selection box can be changed in shading or color.

[0037] For example, if a content object within the selection box is currently an unselected content object, then that content object can be changed to a green colored shading. This indicates to the user that this content object is added to the selected content if the user releases the button on the input device with the selection box (402) approximately around that content object.

Conversely, if a content object within a selection box is currently a selected content object, then that content object can be changed to a red colored shading. This indicates to the user that that content object will be removed if the user releases the button on the input device with the selection box (402) approximately around that content object. In some examples, the color of the entire region within the entire selection box (402) may be changed based on the content objects within the selection box (402).

[0038] In the example illustrated by Fig. 5, a selection box (402) is drawn approximately around text object 2 (206-2) and text object 3 (206-3). Because text object 2 (206-2) is originally an unselected content object, it is attributed a green colored shading (504) indicating that it is to become selected. Additionally, because text object 3 (206-3) is originally a selected content object, it is attributed a red colored shading (502), indicating that it is to become unselected.

[0039] Fig. 6 is a diagram showing an illustrative graphic user interface (600) with a snapped selection box (604). According to certain illustrative examples, when a user indicates a content object or group of content objects, the selection box can snap around the borders of the indicated content object or group of content objects. This can occur after the physical computing system (e.g. 100, Fig. 1) has matched the region indicated by the selection box with the content object or group of content objects in that region. The selected content objects can have colored shading according to whether they are to be added or removed from the set of selected content objects as described above.

[0040] The snapped selection box (604) can have a number of handles at the corners and in the middle of each line of the snapped selection box (604). These handles (602) can allow the user to extend the selection box to include an additional content object. Additionally or alternatively, the user can use the handles (602) to contract the snapped selection box (604) to exclude a content object. After the user is satisfied with the content objects indicated by the snapped selection box (604), the user can give input to the physical computing system to cause the snapped selection box to be finalized. Finalizing the snapped selection box adds or removes the appropriate content objects from the set of objects selected for extraction. The shading of the content objects is then changed accordingly.

[0041] Figs. 7A and 7B illustrate possible printouts of selected content objects of a graphical user interface. After the user is satisfied with the set of content objects which have been selected for extraction, the user may execute the extraction. In one example, the selected content may be transferred to another program such as a word processing application. In one example, the selected content is sent to a printing device to be printed. The manner in which the selected content objects are printed may vary. [0042] In one example, as illustrated in Fig. 7A, the printout (700) of the selected content objects is printed with the selected content objects in their original relative positions. The unselected content objects are simply removed and replaced with blank spaces. In one example as illustrated in Fig. 7B, the printout (702) of the selected content objects is printed with the spacing of the unselected content objects removed.

[0043] Fig. 8 is a flowchart showing an illustrative method for selecting content within a user interface. According to certain illustrative examples, the method includes receiving (block 802), with a physical computing system, input from a user indicating a region within a graphical user interface and determining (block 804), with the physical computing system, at least one content object associated with the region of the graphical user interface. The method then determines (decision 806) whether the at least one content object is currently selected. If the at least one content object is not selected (decision 806, NO), then the method proceeds by selecting (block 808), with the physical computing system, the at least one content object associated with the region. If the at least one content object is indeed selected (decision 806, YES), then the method proceeds by unselecting (block 810), with the physical computing system, the at least one content object associated with the region.

[0044] In sum, through use of methods and systems embodying principles described herein, a user is provided with an efficient and intuitive way to add and remove content which is selected for abstraction. By maintaining the display of all content, whether selected or unselected, the user can easily switch various content objects within the display between a selected and an unselected status. When the user is ready, he or she can execute the extraction process which will extract the selected content for whatever purpose the user desires.

[0045] The preceding description has been presented only to illustrate and describe embodiments and examples of the principles described. This description is not intended to be exhaustive or to limit these principles to any precise form disclosed. Many modifications and variations are possible in light of the above teaching.