Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
TAGS FOR AUTOMATICALLY TRIGGERING PHYSICAL WORLD ACTIONS WITH INTERACTION
Document Type and Number:
WIPO Patent Application WO/2011/039551
Kind Code:
A1
Abstract:
The invention allows a user of a computing device (mobile, PC, laptop etc) to automatically execute actions and connect to digital information when said computing device interacts with other computing devices or print outs. The invention allows the creation of optically detectable tags and the interaction comprises of the decoding of these tags and driving to click to action activities. The invention allows the creation of tags and the posting to online media. It also allows part of the information to be available offline and part of the information to be stored online to allow for traceability but also to control the size of the code. It also exposes users of other decoding applications to the user experience of the particular system. Successful decoding is signaled by visual, haptic and audio feedback. The client application serves as the physical world browser of digital information allowing for context related content serving.

Inventors:
KONTARINIS DIMITRIOS (GR)
KOUTSOVASSILIS ANASTASSIOS (GR)
GIANNAKIS KONSTANTINOS (GR)
Application Number:
PCT/GR2010/000041
Publication Date:
April 07, 2011
Filing Date:
September 27, 2010
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
TAGEM S A (GR)
KONTARINIS DIMITRIOS (GR)
KOUTSOVASSILIS ANASTASSIOS (GR)
GIANNAKIS KONSTANTINOS (GR)
International Classes:
G06K17/00; G06Q90/00; G06K19/00
Foreign References:
US6666377B12003-12-23
US20020102966A12002-08-01
US20050125301A12005-06-09
Other References:
None
Attorney, Agent or Firm:
CHALDAIOU, Maria (44 Kifissias Av, Maroussi Attikis, GR)
Download PDF:
Claims:
CLAIMS

What is claimed is:

1. A method of producing tags (in printed or projected eg on a computer monitor_ € form) which includes the generation of one or multidimensional barcodes using known encoding schemes that encode information or matching information to a pattern (image or drawing) and is characterized by the fact that the information encoded is accessible both offline and online. Furthermore, it is characterized by the fact that the offline information contains the characterization about the kind of information (eg email address) accessible +0 online even in the absence of connection when the online information is not accessible as a whole.

2. A method of decoding the tags produced by the method described in claim 1, which includes the scanning by the camera of a computing device (eg a mobile phone)

4€ the processing and decoding of the contained information and is characterized from the fact it recognizes which part of the information is directly available and which is available using an online connection as well as the kind of information that is available online even in the absence of connection (so for example the decoding application "knows" that the information of email address is available without knowing the exact

20 email address even when the application works offline, and then restores the actual information when online).

3. A system that implements method of claim 2 where the information encoded directs to an interface which adapts to the decoded information and contains relevant ( to

2€ the decoded information) and adapted click to actions (eg send email, send text message, add to contacts).

4. The system of claim 3 where successful detection of the code is accompanied by audio, visual and haptic feedback

30

5. The system of claim 3 where action triggered by the code is performed from within the application.

6. The method of claim 2 where the decoding is done on a remote (server side) server.

Description:
Tags for automatically triggering physical world actions with interaction.

This invention relates generally to encoding data using barcode encoding or pattern matching (the term pattern refers to image, drawing or pictogram) in such a way so that § metadata will be readily available to the decoding application allowing it to adjust its interface and actions accordingly.

Barcodes (especially two or multi dimensional barcodes which are included in our referrals of "barcodes" throughout the text) are becoming an increasingly popular 0 medium for encoding information that can be accessible by camera equipped phones and computers. The reason being that there is an increasing number of computing devices that come equipped with high quality cameras making the scanning of these codes easier. There are many coding schemes around, originating from entities ranging from smaller to big companies but this has no effect to the invention as the invention will incorporate the

+5 encoding and the decoding of all popular encoding and decoding schemes (with available open standards ).

The invention treats barcodes as means of physical tagging and as such it encompasses a more general population of such tags. We refer to these tags using the terms "barcodes",

2© "patterns" and "tags" and with the term "tags" we engulf the terms "barcodes" and "patterns" throughout the text interchangeably. In this train of thought the invention allows for the training and recognition of patterns (such as logos) that will be associated to certain digital information which an administrator will be able to modify. The method also incorporates means to store location coordinates and as such users will be able to

25 both interact with available information but also add information (something we call digital graffiti). Furthermore, it allows for tag category recognition (eg a tag containing social information, accreditation information etc) before the use of a local processing application (just by recognizing the pattern of the barcode making it easy therefore to know a priori that there is information contained and giving initial indication of what

30 information is contained). The invention contains a method for creating barcodes (using existing and preferably most popular schema) where upon design and creation, part of the information is chosen to be online and part offline. The fact that some of the information is online and some is offline allows for the creation of barcodes of controllable size which at the same time are S readable by computing device cameras (without the use of special lenses). It also allows for the design of the interface for the clickable actions (when information is decoded or pattern is matched) while creating those barcodes. This allows for the option to choose which actions to emphasize depending on the type of application. The invention contains a method of decoding barcodes and matching pattern that it has been trained to match. In0 doing so on top of the visual indications and feedback it also provides with haptic and audio feedback. This has the added advantage of the faster human response as studies show. Furthermore, the decoding or matching function is done automatically meaning the system recognizes when successful decoding has been done and it stops (rather than having the user to repeat the process in case of failure). Better description of the- invention can be found below with the description of a preferred embodiment.

Barcodes' importance has become more evident with the progress in new barcode encoding as well as in camera equipped computing devices. It has become very easy and relatively fault tolerant to scan barcodes using wide spread computing devices. This0 poses with a promising future for the adoption of theses barcodes as what we think as physical (real) tags. Of course, there will be an adoption time during which one must leverage on ways to spearhead the barcode penetration and to encompass other forms of physical tagging. 5 Overall, decoding tags involves a multi stage process which upon successful completion leads to a redirection to the decoded information. Failure of decoding usually, requires the initiation of the process again. Once redirection has been achieved, then an independent initiation of subsequent actions depending on the computing device can be followed independent of the decoding application.

0 On the encoding front, the information is either accessible offline or online (with some text string link). The advantage of offline information is that it is available even in the absence of a connection whereas the online can be more (in quantity) and editable (different information for the same barcode).

The present invention aims to create barcodes with controllable sizes (and readable by mobile phones) so that it is aesthetically pleasing and easy to place and a way to access the information stored that will allow for easy to use actions with an unparalleled user experience.

The invention creates and uses barcodes that access both offline and online information giving the ability to both control the physical size of the barcode and to update related online material without the need of changing the barcode. It also adapts user interaction according to the information contained and allows for actions to be triggered within the application. The invention also uses haptic feedback which allows for faster perception and continuous sampling of pattern to be matched or code to be decoded.

The invention will initially focus in applications using the mobile phone while in front of a computer screen (or another mobile phone) to transfer data on the mobile phone. So for example instead of having to insert a new contact in your address book or sync your phone you only have to scan a barcode off your screen and download the contact details (just in a snap). Focus is on scanning digital information from the PC screen using the mobile phone to easily perform calls, send sms', keep offline on the go notes and directions, download contacts (without the need of synchronization).

The invention has two main components a web code management tool and a client (reader and management for mobile or other computing device).

The web management tool allows users to create codes that contain a number of data. Users will be able to create smart codes that will correspond to business, social and casual cards. These codes will be then seamlessly posted in their blogs, mail signatures, social network profiles. The way the information is encoded in these smart codes allows for a customized look & feel when these are scanned which can be controlled by the web management tool. To preserve the size of the code small and useable some of the data will be decoded locally while other will be reached online with the use of a connection. This will allow for the posting in their social network profiles, blogs etc and therefore will strengthen dissemination of these codes.

The reading tool (client decoding application) adopts to the options set by the user when encoding the codes. This way different information can take different priorities and different kinds of codes can be created supporting different functionalities (professional or social profile, ad hoc events and causes). So for example there is a professional profile where users can input relevant business oriented information, a social profile where users can input relevant social network information and invitation and events where users can input information such as the location and host of the event and calendar information. Successful decoding results in haptic, audio and visual feedback, triggering response of the user. Click to actions will trigger activities of calling a person , sending an SMS, adding as a friend in favorite social network, adding to contacts etc.

For example, a user can post his professional code in a social network page. Other users using the camera scanning option (FIG1) will be able to scan the code directly from their computer screen showing the profile page containing the code (FIG2). The scanning will lead to an interface with ready- made click to actions to call, text or other actions (FIG 3). Depending on the way chosen by the user who encoded her own information different types of info can take different priority. In a similar, but different example the user might encode social network information which will lead to subsequent social networking actions (FIG 4) or event information such as location and host and venue information (FIG 5). Subsequent actions such as (for example) choosing which phone (mobile, home, office) depending on the stored information or adding the encoded profile to the address book are then enabled (FIG 6, FIG 7). Furthermore, there is an option to save favorite bookmarks or retrieve history of scanning (FIG 8, FIG 9). FIGURE 1

The reader application includes a log in (1) (and a sign up functionality) and also the ability to scan directly from the camera (2) (or decode pictures from the stored ones)

5 FIGURE 2

Scanning the code created and posted on a social network (1) off the computer screen FIGURE 3

Based on the information encoded the relevant menus and buttons appear for the© professional profile. This is also configurable for example so that either the company name (1 ) or the person's name (2) appear. Then depending on the information encoded there are call (3) , send email (4) , send sms (5) , go to website (6) , Add as friend in Facebook (7) , Follow me on Twitter (8) , view profile on Linked in (9) buttons. S FIGURE 4

The social profiling menu where Add as friend in Facebook (1 ) , Follow me on Twitter (2) , view profile on Linked in (3).

FIGURE 5

0 The event information which includes View Map (1), Call (2), Send Email(3), send SMS (4), and go to website (5) click to action buttons.

FIGURE 6

Drilling down to information encoded there are multiple phone numbers appearing _5 home (1 ), mobile (2), other (3)

FIGURE 7

Adding to contacts (1) 0 FIGURE 8 Favorites menu where saved codes are categorized to contacts (1), events (2), social (3), text (4), sms(5)

FIGURE 9

The History menu (1) with recording of clicked codes and short description of the type of content. Starting from most recent click (2), to older (3), (4) so on so forth.