Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
MULTIPLE DEVICE INTERSECTION USING GEO-TEMPORAL MOBILE APPLICATION DATA
Document Type and Number:
WIPO Patent Application WO/2021/222142
Kind Code:
A1
Abstract:
A computer-implemented method for identifying device intersections using application data derived from multiple mobile devices. The method extracts the unique devices identified in a user defined area of interest (AOI) and generates individual geospatial layers for each device. The layers are derived from the metadata containing coordinates and associated timestamps for all available points of the device. Combining the individual layers will produce a convergence surface of polygonal intersections, indicating where devices have shared additional locations outside the initial AOI. Applying the timestamp to the resulting layer with a user defined time interval will generate a probability matrix of association.

Inventors:
CHAPMAN JEFFREY (US)
MYATT SHON (US)
HAYNIE JAMES (US)
Application Number:
PCT/US2021/029242
Publication Date:
November 04, 2021
Filing Date:
April 26, 2021
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
BABEL STREET INC (US)
International Classes:
G06T17/05; G01C21/32; G06K9/46; G06K9/62
Foreign References:
US20170351657A12017-12-07
US20110191284A12011-08-04
US20170053538A12017-02-23
US20170061625A12017-03-02
US20110071881A12011-03-24
Other References:
YING LU; JUAN A. COLMENARES: "Efficient Detection of Points of Interest from Georeferenced Visual Content", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 2 June 2017 (2017-06-02), 201 Olin Library Cornell University Ithaca, NY 14853 , XP080767186, DOI: 10.1145/3150919.3150920
Attorney, Agent or Firm:
HALL, Jonathan, D. (US)
Download PDF:
Claims:
WHAT IS CLAIMED:

1. A method of evaluating the probability of a relationship between electronic devices, comprising the steps of: defining a geospatial area of interest (AO I) and a time of interest (TOI); identifying devices contained within the AOI and TOI; selecting at least a a subset of the identified devices for searching; defining a radius and a time interval proximity; generating at least one individual geospatial layer for each selected device; creating a convergence surface for the selected devices; retrieving a set of timestamps for each selected device in the convergence surface; identifying the timespan of each convergency based on a first device timestamp and a last device timestamp for each of the selected devices; identifying overlapping time periods for the selected devices; and generate an association matrix for each convergence.

2. The method of claim 1 further comprising the step of generating an overall probably of relationship.

3. The method of claim 1 wherein the convergence surface is a polygonal intercept.

4. The method of claim 1 further comprising the step of calculating an individual convergence yl . . zone C intersection matrix probably score according to: l= — — i ¹ j.

5. The method of claim 1 further comprising the step of calculating an overall network intersection matrix probability score for each device pair according to:

6. A computer-implemented method for identifying device intersections using application data derived from a plurality of mobile devices, comprising the steps of: identifying a plurality of devices contained in a user defined area of interest (AOI) and generating a set of individual geospatial layers for each of the devices, wherein the set of individual geospatial layers are derived from a set of metadata containing coordinates and associated timestamps for all available points for each of the devices; combining the individual layers to produce a convergence surface of polygonal intersections indicating where devices have shared additional locations outside the initial AOI; and applying the timestamps to the resulting layer with a user defined time interval to generate a probability matrix of association.

Description:
Multiple Device Intersection Using Geo-Temporal Mobile Application Data

CROSS-REFERENCE TO RELATED APPLICATION [0001] The present application claims the benefit of U.S. Provisional Patent Application

No. 63/015,908, titled “Multiple Device Intersection Using Geo-Temporal Mobile Application Data” and filed April 27, 2020, the contents of which are incorporated by reference herein in their entirety.

FIELD OF THE DISCLOSURE

[0002] The subject matter of the present disclosure generally relates to geo-temporal data, and more particularly relates to the generation of geo-temporal data from mobile devices as well as devices that produce diagnostic data such as those associated with the Internet of Things (IoT) that provide a capability to identify travel patterns and the rendezvous of those devices with others devices within space and time. These patterns and intersections can create probability matrices that indicate whether a pair of devices demonstrate travel or duration within an area that would denote an association.

BACKGROUND OF THE DISCLOSURE

[0003] Mobile applications and the applications commonly termed the Internet of Things

(IoT) generate the vast amounts of geo-temporal data, data that possesses both geospatial coordinates and a time value within its metadata. Collecting this data by associating a device with a travel pattern allows opportunities to present products, services, intelligence, security, and predictive analysis to users based on user inputs such as locations visited or products consumed. Most of these methods compare single device patterns to known fixed locations. An example of such prior methods includes those described by U.S. Patent No. 8,275,649, titled “Mining life pattern based on location history” and filed September 18, 2009, the contents of which are incorporated by reference herein in their entirety.

[0004] A relatively simple method of serially searching a database of the traveling device locations against a static set of locations will satisfy the requirement to determine when two areas intercept as U.S. Patent No. 8,275,649 outlines. Complexity arises when trying to determine when two or more dynamic devices converge throughout their individual and possibly independent travel patterns. Inferring relationships via proximity and time requires an exhaustive comparison of each datapoint within the search and, as more pairwise comparisons become required, the calculations exceed practical computing capability. Where a device may generate millions of points, the computation, using a balanced matrix between two devices for example, would generate over 500 billion comparisons using the following formula, known as the Condorcet Method, where N represents the number of datapoints present in a matrix per device application.

JV(JV - 1)

= required pairwise comparisons

2

[0005] Determining relationships based on the travel patterns and co-locations within both space and time is not a simple extension of being able to compare a moving object against a static point which is accomplished by N comparisons. Reducing the search space will in turn decrease the number of pairwise comparisons significantly and allow one to build a relationship matrix and identify devices across the temporal plain to determine where devices are converging outside an initial Aol simultaneously. This in effect will allow for the comparison of multiple devices to support force protection, investigations, direct marketing and business intelligence by understanding the movement of groups. Additionally, understanding the travel, proximity, and duration of multiple devices can assist in determining exposure to cross contamination and the spread of pathogens as with epidemiology without the need to draw on Personally Identifiable Information (PII).

[0006] The subject matter of the present disclosure is directed to overcoming, or at least reducing the effects of, one or more of the problems set forth above.

BRIEF SUMMARY OF THE DISCLOSURE

[0007] The disclosed method and system can provide the situational awareness as to intersections between mobile devices and/or other IoT devices that generate diagnostic geo temporal data containing a location and timestamp for each datapoint produced. While methods exist that can determine movement of a single device, such as applications for marketing research, or multiple devices intersecting a known location, there are currently no methods that can determine relationships through the converging of dynamic devices from their initial origin to discover new areas of converging. The method includes identifying a set of devices within a specified area and creating an individual polygon from each device’s point data for a user defined radius. The layering (mashing) of these polygons is used to generate intersections identifying a subset of points that share the same space.

[0008] The method computes the duration that each device remains within the identified intersection(s) by performing a temporal check. Comparing 1 -dimensional overlap of time segments for each data point’s timestamp and a time buffer defined by the user generates an aggregate of these segments to represent the total duration that a device is in an area. The device aggregate is then compared to all other device aggregates in that location to detect overlaps and the mutual duration of time within an intersection.

[0009] A relationship matrix with associated probabilities between devices can be computed using these duration markers and the number of rendezvous the devices make throughout their travel, indicating an association exists compared to random independent movement. The result is a system capable of identifying multiple devices with converging travel patterns. This information can support but is not limited to large-scale marketing research, security, research into group travel behavior, intelligence, advertising, social science, health science, and medical research such as epidemiology.

BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The foregoing summary, preferred embodiments, and other aspects of the present disclosure will be best understood with reference to a detailed description of specific embodiments, which follows, when read in conjunction with the accompanying drawings, in which:

[0011] FIG. 1 is the sequential steps for identifying the relationships between devices producing geo-temporal data.

[0012] FIG. 2 is a concept flowchart of how the computer-implemented method would determine the intersecting polygons, time intervals, and relationship matrices. [0013] FIG. 3 depicts generating individual device polygons.

[0014] FIG. 4 depicts layering the device polygons into a single mashup to identify areas of interest.

[0015] FIG. 5 depicts refining the solution space using the time interval variable and the metadata time stamp.

[0016] FIG. 6 depicts the generation of the relationship matrices for each polygon intersection and time interval and the overall relationship probability matrix.

[0017] Like reference numbers and designations in the various drawings indicate like elements.

DETAILED DESCRIPTION

[0018] In the following detailed description, a reference is made to the accompanying drawings that form part hereof, and in which the specific embodiments that may be practiced is shown by way of illustration. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments and it is to be understood that the logical, mechanical, and other changes may be made without departing from the scope of the embodiments. The following detailed description is therefore not to be taken in a limiting sense.

[0019] Described now is a computer-implemented method for determining the relationships of dynamic mobile devices or IoT devices based on time and space (geo-temporal) data. The method uses polygon intersections of the devices geo-temporal history to generate an association matrix for each device originating from an Area of Interest (Aol). The Matrix is based on the number of times devices converge in both space and duration of time in other areas outside the initial AOI as defined by a user selected radius and time interval. [0020] Referencing Fig 1, the process initiates with a user creating a polygon around a geospatial area of interest (Aol) and defining a timespan of interest (Tol) (Fig 1 - step 101). Using the user polygon and timespan as the boundaries, access is made to a geospatial database containing all geo-temporal datapoints and the device identifiers that meet the criteria are returned (Fig 1 - step 102, Fig 2, Fig 3).

[0021] The user defines a radius for the data point (Fig 1 - step 103, Fig 3) to create a polygon layer for each device within the AOI (or a selected subset of devices within the AOI). The system will retrieve all available datapoints for the individual device(s) selected and generate individual circular polygons for each datapoint (Fig 3). The intersections of the circular polygons merge to produce a single polygon (Fig 1 - step 104, Fig 3).

[0022] The individual polygon layers representing a single device combine to form a surface (mashup) composed of intersections where the polygons layers overlap (Fig 4). The intersection(s) indicates where devices share a common space outside the original Aol.

[0023] Since each datapoint contains a specific point in time, the user will define a timespan. The span will create a buffer to determine if other devices were present during this period by calculating one dimensional overlap. The initial step is to calculate the buffer, defined by the user, for each datapoint belonging to the same device (Fig 1- step 106, Fig 5). These time segments are then overlaid to determine the duration of the device within the intersection(s). The process repeats for all devices within the intersection(s) (Fig 1 - step 107, Fig 5).

[0024] The time segments for all devices within an intersection(s) are overlaid to determine which devices are present within the intersection simultaneously and therefore represents a relationship (Fig 1 - step 108, Fig 5).

[0025] An association matrix is populated based on the intersections that exist between pairs of devices. Probabilities can be computed using the duration when devices are co-located and the frequency of the rendezvous between multiple devices (Fig 1 - step 109, Fig 6). [0026] Algorithms and Heuristics

[0027] In an embodiment, several assumptions are made:

1. Given a buffer around the discrete timestamp for each device datapoint, overlapping intervals will determine the total duration at a location.

2. Relationships exist when devices repeatedly converge within a specified space and time interval.

[0028] In an embodiment method, the following variables can be used:

Dixytrs where:

D - Device i - Unique Device identifier, 1...n x- 1 st coordinate of a two-coordinate system y - 2 nd coordinate of a two-coordinate system t - Unique timestamp for each for each i,x,y observation r - User defined Search Radius s - time overlap interval for determining associations

Dixyt where:

D - Device i - Unique Device identifier, 1...n x- 1 st coordinate of a two-coordinate system y - 2 nd coordinate of a two-coordinate system t - Unique timestamp for each i,x,y observation

C k

Where:

C - Convergence area k - l...k

Where: R — Duration of device i i - l...n l — Instance of device occuring in a unique convergence zone k, 1 ... I

Rijl

Where:

R — Duration of device pairs i, j i - l...n j - 1... m l — Instance of device pairs occurring in a unique convergence zone k, 1 ... I

[0029] Constructing A Polygon Layer for Each Unique Device

[0030] In the construction of a geospatial surface to represent the entirety of a device’s travel, the following algorithms for determining polygonal unions may be used. Additionally, a limit on the distance from the centroid can be used to prevent a single continuous polygon for devices that have generated high volumes of geo-temporal data.

[0031] Constructing the Intersections of Polygon Layers Determine the

Convergence Space for Multiple Devices

[0032] Construction of the intersections of separate devices and the intersecting search space can use a clipping algorithm such as the Vatti clipping Algorithm (Bala R. Vatti) which does not restrict the shape of the polygons and therefore allows for the complex shapes that may arise from the unions operations previously performed to represent a single device. The clipped portion (the intersection of the polygons) becomes the polygon representing the convergence area.

[0033] Determining the Duration of a Single Device for an Area Where an

Intersection of Polygons Exists.

[0034] Each datapoint contains a discrete timestamp and therefore there is a need to have a buffer to determine the duration of a device at a location. Creating a continuous interval based on the overlap of multiple samples creates an estimate of a device’s total duration with an intersection. The duration can be calculated by comparing time intervals from the datapoints. The following heuristic will determine the duration.

For each D ixyts contained within a set representing all the datapoints from a single device contained within the intersecting polygons, the time intervals can be compared based on the time overlap interval 5.

For example

Di xytrs the time internal

Di xy(t+i)rs represents the next datapoint denoted by the next timestamp of the same device contained within the intersecting polygons with the time interval represented by:

For all D L representing the same device, sorting is based on timestamp and the comparison of time duration intervals.

S S S s

If t + - > (t + 1) — - and t — - < (t + 1) + - exists then the overlap in time intervals is present and the new interval replaces both the time duration of both observations as t —

|, (t + 1) + . This process repeats until all timestamp comparisons for all observations of a single device are complete. This process is replicated for all devices present in the search.

The result is a set of polygons that are separated by time intervals for each unique device.

[0035] Determining The Duration Of Multiple Devices for an Area Where an

Intersection of Polygons (From Multiple Independent Devices) Exists.

Determining co-location of separate devices, the comparison is the same as determining the overlap for a single device where for each D ixytrs where i represents each unique device in the intersecting polygon (1, 2, 3,...n) therefore sorting the durations from earliest timestamp per convergence area the following comparison is made if <

5

( D j )t + - where i ¹ j then the two device share a geospatial area and time interval.

[0036] The duration of the two devices, b ί;· , referenced in [0031] is calculated using:

[0037] The intersection of multiple devices is an extension of the process described in

[0035] and [0037] for a pair of devices and follows same construct where the devices are sorted by earliest timestamps and the devices are compared with both the single device [0035] and to the duration interval between devices, therefore a timespan for a device set containing the devices that derived the interval.

[0038] The matrix for calculating the duration between devices for each convergence zone is the summation of the duration period for all instances of the pairs having overlapping time intervals.

[0039] Each convergence zone can have a probability associated between pairs within a convergence zone. The intersection matrix is then computed using the summation of all the i j pairs over all the convergence areas divided by the minimum duration total for each device within the network. The individual convergence zone C intersection matrix probability score for each device pair can be calculated as: i ¹ j

The overall network intersection matrix probability score calculation for each device pair:

The result is a series of probability scores which may identify transitive intersections, such as a high probability between pairs A and B, B and C and therefore there is a network or an association between A and C in continuum until the associations are complete.

[0040] A count of unique intersections between devices with regards to time can provide another method to determine a systematic intersection or a repeating pattern of device movement. The calculation is the maximum index for /, the instance of device pairs occurring in a unique convergence zone 1...1 for unique convergence zone k divided by the maximum index for the individual device with the fewest instances at convergence zone K will generate a metric for determining randomness of devices converging both geospatially and temporally. [0041] Although the disclosed subject matter has been described and illustrated with respect to embodiments thereof, it should be understood by those skilled in the art that features of the disclosed embodiments can be combined, rearranged, etc., to produce additional embodiments within the scope of the invention, and that various other changes, omissions, and additions may be made therein and thereto, without parting from the spirit and scope of the present invention.