Login| Sign Up| Help| Contact|

Patent Searching and Data


Title:
ROUTE DEVIATION QUANTIFICATION AND VEHICULAR ROUTE LEARNING BASED THEREON
Document Type and Number:
WIPO Patent Application WO/2021/236006
Kind Code:
A1
Abstract:
The present disclosure provides methods, devices and systems for route deviation quantification and vehicular route learning based thereon. In some examples, there is provided a method for route deviation quantification of a suggested route. The method comprises: obtaining a ground truth route based on a filtered trajectory, the filtered trajectory including an inferred location of origin and an inferred location of destination; obtaining a suggested route generated based on the inferred location of origin and the inferred location of destination; quantifying a deviation of the suggested route from the ground truth route by calculating an off course ratio based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

Inventors:
XU NUO (SG)
HUANG XIAOCHENG (SG)
YUAN LEI (SG)
BUBNA GAURAV (SG)
WANG ZEHUA (SG)
Application Number:
PCT/SG2020/050295
Publication Date:
November 25, 2021
Filing Date:
May 19, 2020
Export Citation:
Click for automatic bibliography generation   Help
Assignee:
GRABTAXI HOLDINGS PTE LTD (SG)
International Classes:
G01C21/34; G06Q10/04; G06Q50/30
Foreign References:
CN106969782A2017-07-21
JP2009036702A2009-02-19
US20180003516A12018-01-04
KR101843683B12018-03-30
DE102019000617A12019-06-06
Other References:
LETCHNER JULIA, KRUMM JOHN, HORVITZ ERIC: "Trip Router with Individualized Preferences (TRIP): Incorporating Personalization into Route Planning", IAAI'06: PROCEEDINGS OF THE 18TH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 31 July 2006 (2006-07-31), pages 1795 - 1800, XP055874562, Retrieved from the Internet [retrieved on 20211220], DOI: 10.5555/1597122.1597139
DAI JIAN; YANG BIN; GUO CHENJUAN; DING ZHIMING: "Personalized Route Recommendation using Big Trajectory Data", 2015 IEEE 31ST INTERNATIONAL CONFERENCE ON DATA ENGINEERING, 17 April 2015 (2015-04-17), XP032781165, [retrieved on 20200720], DOI: 10.1109/ICDE.2015.7113313
CHEN PENGZHAN, ZHANG XIAOYAN, CHEN XIAOYUE, LIU MENGCHAO: "Path Planning Strategy for Vehicle Navigation Based on User Habits", APPLIED SCIENCES, vol. 8, no. 3, pages 407, XP055874731, DOI: 10.3390/app8030407
Attorney, Agent or Firm:
SPRUSON & FERGUSON (ASIA) PTE LTD (SG)
Download PDF:
Claims:
CLAIMS

What is claimed is:

1 . A method for route deviation quantification of a suggested route, the method compris ing: obtaining a ground truth route based on a filtered trajectory, the filtered trajectory including an inferred location of origin and an inferred location of destination; obtaining a suggested route generated based on the inferred location of origin and the inferred location of destination; and quantifying a deviation of the suggested route from the ground truth route by cal culating an offcourse ratio based on a combined length of road segments in the sug gested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

2. The method according to claim 1 , wherein the obtaining the ground truth route com prises: extracting historical data comprising raw GPS data of a historical trajectory on a map; preprocessing the raw GPS data of the historical trajectory to obtain the filtered trajectory with the inferred location of origin and the inferred location of destination, wherein the filtered trajectory comprises a time-ordered sequence of GPS pings, and wherein each of the GPS pings indicates a location of a vehicle at a timestamp during the filtered trajectory; and converting the time-ordered sequence of GPS pings to the ground truth route.

3. The method according to claim 1 , wherein the obtaining the suggested route compris es: building a road network based on the map and a speed profile of the map, the speed profile comprising a collection of speeds, each speed corresponding to a road class in the map; and generating the suggested route based on the road network, the inferred location of origin and the inferred location of destination.

4. The method according to claim 1 , further comprising: if the offcourse ratio is not greater than a threshold value, outputting the suggest ed route in response to a routing request with a location of origin corresponding to the inferred location of origin and a location of destination corresponding to the inferred loca tion of destination. 5. The method according to claim 3, further comprising: if the offcourse ratio is greater than a threshold value, optimising the speed pro file of the map to rebuild the road network for regenerating the suggested route.

6. The method according to any one of claims 1 to 5, further comprising: storing the offcourse ratio to a database corresponding to the suggested route with the inferred location of origin and the inferred location of destination.

7. The method according to claim 2, wherein the converting of the time-ordered se quence of GPS pings to the ground truth route comprises: mapping the time-ordered sequence of GPS pings to a sequence of nodes in the map.

8. The method according to claim 7, wherein the converting of the time-ordered se quence of GPS pings to the ground truth route further comprises: checking connectivity of every two consecutive nodes in the sequence of nodes; and if two consecutive nodes are not connected in the map, identifying a path interconnecting the two consecutive nodes in the map, the path including two or more nodes, and stitching the two consecutive nodes by inserting the two or more nodes between the two consecutive nodes.

9. The method according to claim 1 , wherein calculating the offcourse ratio comprises computing the following equation: wherein P is the suggested route, P is the ground truth route, and Sim(P, P ) is a simi larity score between the suggested route and the ground truth route, wherein road segment’s length in the ground truth route, is the combined length of road segments in the suggested route that are matched to the corre sponding road segments in the ground truth route.

10. The method according to claim 9, further comprising: searching for the road segments in the ground truth route that are matched to the corresponding road segments in the suggested route, wherein the searching for the road segments comprises: sequentially conducting a search for a matching road segment in the ground truth route for each road segment in the suggested route, wherein during each iteration of search, starting the search in the ground truth route from a road segment that is placed subsequent to a last matched road segment in the ground truth route.

11 . A device for route deviation quantification of a suggested route, the device compris ing: a processor module; and a memory module including computer program code; the memory module and the computer program code configured to, with the pro cessor module, cause the device to: obtain a ground truth route based on a filtered trajectory, the filtered trajectory in cluding an inferred location of origin and an inferred location of destination; obtain a suggested route generated based on the inferred location of origin and the inferred location of destination; and quantify a deviation of the suggested route from the ground truth route by calcu lating an offcourse ratio based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

12. The device according to claim 11 , wherein when obtaining the ground truth route, the device is configured to: extract historical data comprising raw GPS data of a historical trajectory on a map; preprocess the raw GPS data of the historical trajectory to obtain the filtered tra jectory with the inferred location of origin and the inferred location of destination, wherein the filtered trajectory comprises a time-ordered sequence of GPS pings, and wherein each of the GPS pings indicates a location of a vehicle at a timestamp during the filtered trajectory; and convert the time-ordered sequence of GPS pings to the ground truth route. 13. The device according to claim 11 , wherein when obtaining the suggested route, the device is configured to: build a road network based on the map and a speed profile of the map, the speed profile comprising a collection of speeds, each speed corresponding to a road class in the map; and generate the suggested route based on the road network, the inferred lo cation of origin and the inferred location of destination .

14. The device according to claim 11 , wherein the device is further caused to: if the offcourse ratio is not greater than a threshold value, output the suggested route in response to a routing request with a location of origin corresponding to the in ferred location of origin and a location of destination corresponding to the inferred loca tion of destination.

15. The device according to claim 13, wherein the device is further caused to: if the offcourse ratio is greater than a threshold value, optimise the speed profile of the map to rebuild the road network for regenerating the suggested route.

16. The device according to any one of claims 11 to 15, wherein the device is further caused to: store the offcourse ratio to a database corresponding to the suggested route with the inferred location of origin and the inferred location of destination.

17. The device according to claim 12, wherein when converting the time-ordered se quence of GPS pings to the ground truth route, the device is configured to: map the time-ordered sequence of GPS pings to a sequence of nodes in the map.

18. The device according to claim 17, wherein when converting the time-ordered se quence of GPS pings to the ground truth route, the device is further caused to: check connectivity of every two consecutive nodes in the sequence of nodes; and if two consecutive nodes are not connected in the map, identify a path interconnecting the two consecutive nodes in the map, the path including two or more nodes, and stitch the two consecutive nodes by inserting the two or more nodes be tween the two consecutive nodes. 19. The device according to claim 11 , wherein when calculating the offcourse ratio, the device is caused to compute the following equation: wherein P is the suggested route, P is the ground truth route, and Sim(P, P ) is a simi larity score between the suggested route and the ground truth route, wherein road segment’s length in the ground truth route, is the combined length of road segments in the suggested route that are matched to the corre sponding road segments in the ground truth route.

20. The device according to claim 19, wherein the device is further caused to: search for the road segments in the ground truth route that are matched to the corresponding road segments in the suggested route, wherein when searching for the road segments, the device is configured to: sequentially conduct a search for a matching road segment in the ground truth route for each road segment in the suggested route, wherein during each iteration of search, start the search in the ground truth route from a road segment that is placed subsequent to a last matched road segment in the ground truth route.

21 . A method for vehicular route learning, the method comprising: retrieving a training data set corresponding to historical trajectories on a map; optimising a speed profile of the map to achieve a minimised average offcourse ratio for the training data set; and updating the speed profile for the map.

22. The method according to claim 21 , further comprising: contructing the training data set, wherein the training data set comprises a collec tion of data points, wherein each data point corresponds to one of the historical trajectories on the map and contains: an inferred location of origin of the historical trajectory, an inferred location of destination of the historical trajectory, a suggested route connecting the inferred location of origin and the in ferred location of destination generated based on the map and the speed profile, and a corresponding ground truth route of the historical trajectory

23. The method according to claim 22, further comprising: constructing the speed profile, wherein the speed profile comprises a collection of speeds, each speed corresponding to a road class in the map.

24. The method according to claim 23, wherein the optimising the speed profile to achieve the minimised average offcourse ratio for the training data set comprises: calculating an offcourse ratio for each suggested route in the training data set to quantify a deviation between the suggested route and the corresponding ground truth route based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the corresponding ground truth route and a combined length of road segments in the corresponding ground truth route; aggregating calculated offcourse ratios and determine an average offcourse ratio for all the suggested routes in the training data set; and for each road class in the map, optimising the corresponding speed to identify an optimised speed that enables the route engine generator module to regenerate suggest ed routes for inferred locations of origin and inferred locations of destination in the train ing data set with a minimised average offcourse ratio.

25. The method according to any one of claims 22 to 24, further comprising: generating and outputting a suggested route based on the map and the updated speed profile in response to a routing request with a location of origin corresponding to one of the inferred locations of origin and a location of destination corresponding to one of the inferred locations of destination.

26. The method according to claim 24, wherein the optimising of the corresponding speed for each road class in the map comprises: comparing whether the determined average offcourse ratio for all the suggested routes in the training data set is greater than an existing average offcourse ratio of the map; and if the determined average offcourse ratio for all the suggested routes in the train ing data set is greater than the existing average offcourse ratio of the map, adjust the corresponding speed of a road class in the speed profile; build a road network based on the map and the adjusted speed profile having the adjusted corresponding speed; provide the road network, the inferred locations of origin and the inferred locations of destination to the route plan module to regenerate suggested routes; recalculate an offcourse ratio for each regenerated suggested route to quantify a deviation between the regenerated suggested route and the corre sponding ground truth route; aggregate recalculated offcourse ratios and determine an average off course ratio for all the regenerated suggested routes; compare whether the determined average offcourse ratio for all the re generated suggested routes is greater than the existing average offcourse ratio of the map; and if the determined average offcourse ratio for all the regenerated suggest ed routes is greater than the existing average offcourse ratio of the map, iterate adjusting the corresponding speed of the road class, if the determined average offcourse ratio for all the regenerated suggest ed routes is not greater than the existing average offcourse ratio of the map, identify the adjusted corresponding speed as the optimised speed for the road class.

27. The method according to claim 24, wherein the optimising of the corresponding speed for each road class in the map comprises: comparing whether the determined average offcourse ratio for all the suggested routes in the training data set is greater than an existing average offcourse ratio of the map; and if the determined average offcourse ratio for all the suggested routes in the train ing data set is not greater than the existing average offcourse ratio of the map, identify the corresponding speed as the optimised speed for the road class.

28. The method according to claim 21 , further comprising: partitioning historical data into a plurality of training data sets that include the re trieved training data set, the historical data comprising raw GPS data of historical trajec tories stored in a database module, wherein each training data set in the plurality of training data sets comprises data points corresponding to historical trajectories captured in a pre-determined hour of a day on the map. 29. The method according to claim 28, further comprising: preprocessing the raw GPS data of the historical trajectories to obtain filtered tra jectories with the locations of origin and the locations of destination, wherein each of the filtered trajectories comprises a time-ordered sequence of GPS pings, and wherein each of the GPS pings indicates a location of a vehicle at a timestamp during the filtered trajectory.

30. The method according to claim 28 or 29, further comprising: aggregating the raw GPS data of the historical trajectories to determine a histori cal speed for each road class in the map so as to construct the speed profile, and building a road network based on the speed profile and the map.

31 . The method according to claim 29, further comprising: for each of the filtered trajectories, converting the time-ordered sequence of GPS pings to the ground truth route in the training data set.

32. The method according to claim 21 , wherein the calculating of the offcourse ratio for each suggested route comprises computing the following equation: wherein P is the suggested route, P is the corresponding ground truth route, and

Sim(P, P ) is a similarity score between the suggested route and the corresponding ground truth route, wherein denotes each road segment’s length in the corresponding ground truth route, and

SequentialOverlap is the combined length of road segments in the suggested route that are matched to the corresponding road segments in the corresponding ground truth route.

33. The method according to claim 32, further comprising: searching for the road segments in the ground truth route that are matched to the corresponding road segments in the suggested route, wherein the searching for the road segments comprises: sequentially conducting a search for a matching road segment in the ground truth route for each road segment in the suggested route, wherein during each iteration of search, starting the search in the ground truth route from a road segment that is placed subsequent to a last matched road segment in the ground truth route.

34. A system for vehicular route learning, the system comprising: a processor module; and a memory module including computer program code; the memory module and the computer program code configured to, with the pro cessor module, cause the system to: retrieve a training data set corresponding to historical trajectories on a map; optimise a speed profile of the map to achieve a minimised average offcourse ra tio for the training data set; and update the speed profile for the map.

35. The system according to claim 34, wherein the training data set comprises a collec tion of data points, wherein each data point corresponds to one of the historical trajecto ries on the map and contains: an inferred location of origin of the historical trajectory, an inferred location of destination of the historical trajectory, a suggested route connecting the inferred location of origin and the in ferred location of destination generated based on the map and the speed profile, and a corresponding ground truth route of the historical trajectory

36. The system according to claim 35, wherein the speed profile comprises a collection of speeds, each speed corresponding to a road class in the map.

37. The system according to claim 36, wherein when optimising the speed profile to achieve the minimised average offcourse ratio for the training data set, the system is caused to: calculate an offcourse ratio for each suggested route in the training data set to quantify a deviation between the suggested route and the corresponding ground truth route based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the corresponding ground truth route and a combined length of road segments in the corresponding ground truth route; aggregate calculated offcourse ratios and determine an average offcourse ratio for all the suggested routes in the training data set; and for each road class in the map, optimise the corresponding speed to identify an optimised speed that enables the route engine generator module to regenerate suggest ed routes for inferred locations of origin and inferred locations of destination in the train ing data set with a minimised average offcourse ratio.

38. The system according to claim 37, wherein the system is further caused to: generating and outputting a suggested route based on the map and the updated speed profile in response to a routing request with a location of origin corresponding to one of the inferred locations of origin and a location of destination corresponding to one of the inferred locations of destination.

39. The system according to claim 37, wherein when optimising the corresponding speed for each road class in the map, the system is caused to: compare whether the determined average offcourse ratio for all the suggested routes in the training data set is greater than an existing average offcourse ratio of the map; and if the determined average offcourse ratio for all the suggested routes in the train ing data set is greater than the existing average offcourse ratio of the map, adjust the corresponding speed of a road class in the speed profile; build a road network based on the map and the adjusted speed profile having the adjusted corresponding speed; provide the road network, the inferred locations of origin and the inferred locations of destination to the route plan module to regenerate suggested routes; recalculate an offcourse ratio for each regenerated suggested route to quantify a deviation between the regenerated suggested route and the corre sponding ground truth route; aggregate recalculated offcourse ratios and determine an average off course ratio for all the regenerated suggested routes; compare whether the determined average offcourse ratio for all the re generated suggested routes is greater than the existing average offcourse ratio of the map; and if the determined average offcourse ratio for all the regenerated suggest ed routes is greater than the existing average offcourse ratio of the map, iterate adjusting the corresponding speed of the road class, if the determined average offcourse ratio for all the regenerated suggest ed routes is not greater than the existing average offcourse ratio of the map, identify the adjusted corresponding speed as the optimised speed for the road class.

40. The system according to claim 37, wherein when optimising the corresponding speed for each road class in the map, the system is caused to: compare whether the determined average offcourse ratio for all the suggested routes in the training data set is greater than an existing average offcourse ratio of the map; and if the determined average offcourse ratio for all the suggested routes in the train ing data set is not greater than the existing average offcourse ratio of the map, identify the corresponding speed as the optimised speed for the road class.

41 . The system according to claim 37, wherein the system is further caused to: partition historical data into a plurality of training data sets that include the re trieved training data set, the historical data comprising raw GPS data of historical trajec tories stored in a database module, wherein each training data set in the plurality of training data sets comprises data points corresponding to historical trajectories captured in a pre-determined hour of a day on the map.

42. The system according to claim 41 , wherein the system is further caused to: preprocess the raw GPS data of the historical trajectories to obtain filtered trajec tories with the locations of origin and the locations of destination, wherein each of the filtered trajectories comprises a time-ordered sequence of GPS pings, and wherein each of the GPS pings indicates a location of a vehicle at a timestamp during the filtered trajectory.

43. The system according to claim 41 or 42, wherein the system is further caused to: aggregate the raw GPS data of the historical trajectories to determine a historical speed for each road class in the map so as to construct the speed profile, and build a road network based on the speed profile and the map.

44. The system according to claim 42, wherein the system is further caused to: for each of the filtered trajectories, convert the time-ordered sequence of GPS pings to the ground truth route in the training data set. 45. The system according to claim 37, wherein when calculating of the offcourse ratio for each suggested route, the system is caused to compute the following equation: wherein P is the suggested route, P is the corresponding ground truth route, and

Sim(P, P ) is a similarity score between the suggested route and the corresponding ground truth route, wherein denotes each road segment’s length in the corresponding ground truth route, and 's the combined length of road segments in the suggested route that are matched to the corresponding road segments in the corresponding ground truth route.

46. The system according to claim 45, wherein the system is further caused to: search for the road segments in the ground truth route that are matched to the corresponding road segments in the suggested route, wherein when searching for the road segments, the system is configured to: sequentially conduct a search for a matching road segment in the ground truth route for each road segment in the suggested route, wherein during each iteration of search, start the search in the ground truth route from a road segment that is placed subsequent to a last matched road segment in the ground truth route.

Description:
Route Deviation Quantification and Vehicular Route Learning

Based Thereon

FIELD OF INVENTION

[01] The present disclosure relates broadly, but not exclusively, to methods, de vices and systems for route deviation quantification and vehicular route learning based thereon.

BACKGROUND

[02] Vehicular routing is of fundamental importance in ride-hailing industry for loca tion-based services such as estimated time of arrival (ETA), pricing, navigation, nearest driver search, etc. Accurate route planning is a key factor in providing excellent transpor tation experience to customers by avoiding additional cost (e.g., tolls and Electronic Road Pricing (ERP), heavy traffic and road restrictions.

[03] Traditional vehicle routing is cost-centric and aims at finding routes with minimal costs (e.g., via shortest distance or shortest travel time). Shortest path algorithms, e.g. Dijkstra’s algorithm and contraction hierarchies, are used to suggest fastest or shortest routes in traditional vehicle routing.

[04] However, in real life cases, drivers often choose routes which are often neither fastest nor shortest and differ substantially from those suggested fastest or shortest routes. The deviation between drivers’ actual routes and vehicle routing suggested fast est or shortest routes can be caused by various factors, such as toll avoidance, road conditions, or even personal reasons.

[05] Current vehicle routing methods attempt to minimise the deviation by learning drivers’ trajectory data that capture movements of vehicles to optimise cost on each edge or road segment in road networks so as to suggest shortest routes that are as close as drivers’ actual routes.

[06] However, multiple challenges exist in the current vehicle routing methods, which include: a. how to quantify the deviation between vehicle routing suggested routes and drivers’ actual routes in order to minimise the deviation for improving routing results; b. how to efficiently and effectively learn drivers’ raw trajectory data, which is of great vol ume and can be noisy, for improving routing results; and c. how to improve the routing such that it works well in different countries or geographical regions despite hyper-local situations (e.g., in southeast Asia, traffic rules, road conditions and regulations vary sig nificantly in each country).

[07] A need therefore exists to provide methods and devices that seek to overcome or at least minimize the above mentioned challenges and provide accurate route planning.

SUMMARY

[08] According to a first aspect of the present disclosure, there is provided a method for route deviation quantification of a suggested route. The method comprises: obtaining a ground truth route based on a filtered trajectory, the filtered trajectory including an in ferred location of origin and an inferred location of destination; obtaining a suggested route generated based on the inferred location of origin and the inferred location of des tination; quantifying a deviation of the suggested route from the ground truth route by calculating an offcourse ratio based on a combined length of road segments in the sug gested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

[09] According to a second aspect of the present disclosure, there is provided a de vice for route deviation quantification of a suggested route. The device comprises a pro cessor module and a memory module including computer program code. The memory module and the computer program code are configured to, with the processor module, cause the device to: obtain a ground truth route based on a filtered trajectory, the filtered trajectory including an inferred location of origin and an inferred location of destination; obtain a suggested route generated based on the inferred location of origin and the in ferred location of destination; and quantify a deviation of the suggested route from the ground truth route by calculating an offcourse ratio based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

[010] According to a third aspect of the present disclosure, there is provided a method for vehicular route learning. The method comprises: retrieving a training data set corre- sponding to historical trajectories on a map; optimising a speed profile of the map to achieve a minimised average offcourse ratio for the training data set; and updating the speed profile for the map.

[011] According to a fourth aspect of the present disclosure, there is provided a system for vehicular route learning. The system comprises a processor module and a memory module including computer program code. The memory module and the computer pro gram code are configured to, with the processor module, cause the system to: retrieve a training data set corresponding to historical trajectories on a map; optimise a speed pro file of the map to achieve a minimised average offcourse ratio for the training data set; and update the speed profile for the map.

BRIEF DESCRIPTION OF THE DRAWINGS

[012] Embodiments and implementations are provided by way of example only, and will be better understood and readily apparent to one of ordinary skill in the art from the fol lowing written description, read in conjunction with the drawings, in which:

[013] Figure 1 is a schematic diagram of a computing device. The computing device can be implemented as a device for route deviation quantification or a system for vehic ular route learning, according to embodiments of the present application.

[014] Figure 2 is a schematic diagram of a device for route deviation quantification, ac cording to an embodiment.

[015] Figure 3 is a block diagram of a device for route deviation quantification module, according to another embodiment.

[016] Figure 4 is a flow chart illustrating a method for route deviation quantification, ac cording to an embodiment.

[017] Figure 5 is an exemplary diagram showing raw GPS data and pre-processed GPS data, according to an embodiment. The pre-processed GPS data can be used in a routing-metric computation module to evaluate suggested routes suggested by a route engine module as shown in Figure 2. The evaluation result produced by the routing- metric computation module can further be used for downstream applications, e.g. ve hicular route learning. [018] Figure 6 shows an exemplary method for computing a combined length of road segments in a suggested route that are matched to road segments in a ground truth route, which is presented in the form of an algorithm, according to an embodiment. This exemplary method can be used in step 412 of the exemplified method 400 for route de viation quantification as shown in Figure 4.

[019] Figure 7 shows a schematic diagram of a system for vehicular route learning, ac cording to an embodiment.

[020] Figure 8 shows a schematic diagram of a system for vehicular route learning, ac cording to another embodiment.

[021] Figure 9 is a flow chart illustrating a method for vehicular route learning, accord ing to an embodiment. Vehicular route learning can be an independent process which can be triggered on demand or in a batch, depending on various requirements.

[022] Figure 10 is a flow chart illustrating a method for optimising speed for each road class in the map, according to an embodiment. This method includes sub-steps that can be used in step 904 of the exemplified method 900 for vehicular route learning, as shown in Figure 9.

[023] Figure 11 shows an exemplary method for optimising speed for each road class in the map, which is presented in the form of an algorithm, according to an embodiment. This method includes sub-steps that can be used in step 904 of the exemplified method 900 for vehicular route learning, as shown in Figure 9.

[024] Figure 12 shows a diagram depicting a relationship between offcourse ratio and road class speed without optimisation, according to an embodiment. This relationship can be obtained during implementation of the exemplary method for optimising speed for each road class in a map as exemplified in Figure 11. The relationship can be obtained based on historical trajectories captured during a pre-determined period of time (e.g. every 8AM to 9AM of a week) in a pre-determined city (e.g. Bangkok), which can be in turn used to identify an optimised speed for each road class at the pre-determined period of time (e.g. 8AM to 9AM) in the pre-determined city (e.g. Bangkok) according to the methods and systems for vehicular route learning as exemplified in Figures 7 to 11 . [025] Figure 13 is a block diagram of a parallel computing system suitable for use in implementation of the methods and devices for route deviation quantification as exempli fied in Figures 1 to 6 and/or the methods and systems for vehicular route learning as ex emplified in Figures 7 to 11 .

[026] Figure 14 is a block diagram of a computer system suitable for use as a device for route deviation quantification as shown in Figures 2 to 3 and/or a system for vehicular route learning as shown in Figures 7 to 8.

[027] Figure 15 is a schematic diagram of a computer system suitable for implementing the steps as required in a method for route deviation quantification as described herein (e.g. as exemplified in Figure 4) and/or a method for vehicular route learning as de scribed herein (e.g. as exemplified in Figures 9 to 10).

[028] Skilled artisans will appreciate that elements in the figures are illustrated for sim plicity and clarity and have not necessarily been depicted to scale. For example, the di mensions of some of the elements in the illustrations, block diagrams or flowcharts may be exaggerated in respect to other elements to help to improve understanding of the present embodiments.

DETAILED DESCRIPTION

[029] Embodiments will be described, by way of example only, with reference to the drawings. Like reference numerals and characters in the drawings refer to like elements or equivalents.

[030] Some portions of the description which follows are explicitly or implicitly present ed in terms of algorithms and functional or symbolic representations of operations on data within a computer memory. These algorithmic descriptions and functional or sym bolic representations are the means used by those skilled in the data processing arts to convey most effectively the substance of their work to others skilled in the art. An algo rithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities, such as electrical, magnetic or optical signals capable of being stored, trans ferred, combined, compared, and otherwise manipulated.

[031] Unless specifically stated otherwise, and as apparent from the following, it will be appreciated that throughout the present specification, discussions utilizing terms such as “extracting”, “preprocessing”, “converting”, “building”, “providing”, “generating”, “quantify ing”, “calculating”, “outputting”, “optimising”, “rebuilding”, “storing”, ’’mapping”, “checking”, “identifying”, “stitching”, “searching”, “conducting”, “starting”, “aggregating”, “determining”, “regenerating”, “updating”, “comparing”, “adjusting”, “recalculating”, “partitioning”, “ob taining” or the like, refer to the action and processes of a computer system, or similar electronic device, that manipulates and transforms data represented as physical quanti ties within the computer system into other data similarly represented as physical quanti ties within the computer system or other information storage, transmission or display de vices.

[032] The present specification also discloses apparatus for performing the operations of the methods. Such apparatus may be specially constructed for the required purposes, or may comprise a computer or other device selectively activated or reconfigured by a computer program stored in the computer. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various ma chines may be used with programs in accordance with the teachings herein. Alternatively, the construction of more specialized apparatus to perform the required method steps may be appropriate. The structure of a computer suitable for executing the various methods / processes described herein will appear from the description below.

[033] In addition, the present specification also implicitly discloses a computer program, in that it would be apparent to the person skilled in the art that the individual steps of the method described herein may be put into effect by computer code. The computer pro gram is not intended to be limited to any particular programming language and imple mentation thereof. It will be appreciated that a variety of programming languages and coding thereof may be used to implement the teachings of the disclosure contained herein. Moreover, the computer program is not intended to be limited to any particular control flow. There are many other variants of the computer program, which can use dif ferent control flows without departing from the scope of the specification.

[034] Furthermore, one or more of the steps of the computer program may be per formed in parallel rather than sequentially. Such a computer program may be stored on any computer readable medium. The computer readable medium may include storage devices such as magnetic or optical disks, memory chips, or other storage devices suit able for interfacing with a computer. The computer readable medium may also include a hard-wired medium such as exemplified in the Internet system, or wireless medium such as exemplified in the GSM mobile telephone system. The computer program when load ed and executed on such a computer effectively results in an apparatus that implements the steps of the preferred method.

[035] A road network is a weighted graph representation of a map. The road network can be represented as G = (V, E, W), which comprises: a vertex set V including a plu rality of nodes v in the graph; an edge set E £ V X V including a plurality of road seg ments, each road segment being represented by a start node and an end node with a direction; and a weight function W which maps each road segment to a duration. In the present application, a road segment is interchangeably referred as an edge.

[036] The metadata of the road network, including node attributes (node location, etc) and road segment attributes (segment distance, road class of each segment, etc) and topology information, is stored in the map. The road network may include further infor mation, such as turn restrictions, one-ways, etc. For the sake of simplicity, the further information of the road network is not discussed in the present application.

[037] A route plan, which is interchangeably referred as “route” in the present applica tion, can be represented as P =< v 1 , v 2 , · , v k >, which is a sequence of nodes in which every two consecutive nodes are connected by an edge (i.e. road segment). A route can also be represented as P =< e lt e 2 , , e k >, which is a sequence of road segments each being represented by a start node and an end node, wherein for every two consecutive segments = o it d j and e i+1 = ( o i+1 , d i+1 ), di = o i+1 . That is, in every two consecutive road segments, the end node of a first road segment is the start node of a second road segment.

[038] A trajectory is a time-ordered sequence of Global Positioning System (GPS) pings capturing movement of a vehicle, where a GPS ping is represented as a triplet (ts, lat, Ion) indicating a location (composed as latitude lat and longitude Ion) of the vehicle at a timestamp ts. In GPS systems, the distance between two locations is a haversine dis tance, i.e. angular distance. The time gap between two consecutive pings is usually around one second.

[039] A map has a speed profile that includes a collection of speeds each correspond ing to a road class on the map. In Open Street Map, each road segment contains road class information which identifies the type of the road (e.g., motorway, primary road, secondary road, etc). The weight (duration) of each road segment can be easily derived from distance (i.e. the length between a start node and an end node of a road segment) and speed (i.e. which can be obtained from a speed profile based on the road class a road segment belongs to). Since the distance of each road segment is known in each map, a road network, i.e. a weighted graph representation of a map, can be built on a map and its speed profile.

[040] In the present application, embodiments are provided with regards to a routing metric, i.e. route deviation quantification, to quantify a difference between a route sug gested by a route engine module and an actual route taken by a driver so as to evaluate performance of the route suggestion. It is appreciable to those skilled in the art that other types of routing metrics, e.g. cost, delay, etc., can also be used to quantify differences between a route suggested by the routing service and an actual route taken by a driver.

[041] Figure 1 illustrates a schematic diagram of a computing device 100. The device 100 can be implemented as a device for route deviation quantification or a system for vehicular route learning as discussed herein, according to embodiments of the present application.

[042] The device 100 at least includes a processor 102 and a memory 104. The pro cessor 102 and the memory 104 are interconnected. The memory 104 includes comput er program code (not shown in Figure 1 ). The memory 104 and the computer program code are configured to, with the processor 102, cause the device 100 to perform the steps for route deviation quantification or the steps for vehicular route learning as de scribed in the following paragraphs of the present disclosure.

[043] Details of the steps for route deviation quantification will be described below with reference to Figure 4, which depicts a flow chart illustrating a method 400 for route devi ation quantification according to an embodiment. Details of the steps for vehicular route learning will be described below with reference to Figure 9, which depicts a flow chart illustrating a method 900 for vehicular route learning according to an embodiment.

[044] Figure 2 depicts a schematic diagram of a device 200 for route deviation quantifi cation of a suggested route, according to an embodiment. In this embodiment, the de vice 200 includes a preprocessing module 204, a ground truth generator module 206, a route engine module 208 and a routing metrics computation module 210. [045] As shown in the exemplified method 400 for route deviation quantification in Fig ure 4, the device 200 for route deviation quantification, as well as the device 100 when implemented as a device 100 for route deviation quantification, are configured to perform the following steps:

- Step 402: obtaining a ground truth route based on a filtered trajectory, the filtered trajectory including an inferred location of origin and an inferred location of desti nation ;

- Step 404: obtaining a suggested route generated based on the inferred location of origin and the inferred location of destination; and

- Step 406: quantifying a deviation of the suggested route from the ground truth route by calculating an offcourse ratio based on a combined length of road seg ments in the suggested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

[046] At step 402, the routing metrics computation module 210 obtains a ground truth route based on a filtered trajectory. The filtered trajectory includes an inferred location of origin and an inferred location of destination. In some embodiments, the ground truth route is obtained from the preprocessing module 204, and step 402 includes the follow ing sub-steps:

- Step 402A: extracting historical data comprising raw GPS data of a historical tra jectory on a map;

- Step 402B: preprocessing the raw GPS data of the historical trajectory to obtain the filtered trajectory with the inferred location of origin and the inferred location of destination, wherein the filtered trajectory comprises a time-ordered sequence of GPS pings, and wherein each of the GPS pings indicates a location of a vehi cle at a timestamp during the filtered trajectory; and

- Step 402C: converting the time-ordered sequence of GPS pings to the ground truth route [047] At sub-step 402A, the preprocessing module 204 extracts historical data compris ing raw GPS data of a historical trajectory on a map. The map can be a map of a city, such as Singapore, Bangkok, Kuala Lumpur, etc., or a map of a district of such a city, e.g. Central Business District (CBD) area of Singapore, etc.

[048] The historical data includes raw GPS data of historical trajectories captured by an acquisition module 201 of the device 200 and stored in a database module 202 of the device 200. The acquisition module 201 may be a communication module in the device 200. Each historical trajectory in the historical data represents a trip that a driver has taken at a time of a day. The historical data can include historical trajectories that repre sent a considerable number of trips that a plurality of drivers have taken during a day, a week, a month, a year, or any pre-determined interval.

[049] In some embodiments, the historical data can include raw GPS data of historical trajectories captured during a pre-determined period of time. The pre-determined period of time can be, e.g. 8AM to 9AM every day in a predetermined month, or 5PM to 6PM every Friday in a predetermined year. It is up to the practical needs to design such a pre determined period of time for sampling sufficient data.

[050] The raw GPS data of the historical trajectories indicates locations of origin, loca tions of destination, and actual routes that the drivers took during the trips. However, as mentioned above, such raw GPS data is usually of great volume and requires pre processing to obtain ground truth routes for comparison with suggested routes generat ed by the route engine module 208 to quantify inaccuracy (i.e. deviation) of the suggest ed routes. The pre-processing of the raw GPS data is conducted in Step 402B, which will be described in detail in the following paragraphs.

[051] In the present embodiments, one historical trajectory is extracted at step 402A. In some other embodiments, a batch of historical trajectories can be extracted in a similar manner, in which each historical trajectory is extracted and processed independently ac cording to steps 402B-402C and steps 404 to 406.

[052] At step 402B, the preprocessing module 204 preprocesses the raw GPS data of the historical trajectory to obtain a filtered trajectory with an inferred location of origin and an inferred location of destination. The filtered trajectory comprises a time-ordered se- quence of GPS pings, and wherein each of the GPS pings indicates a location of a vehi cle at a timestamp during the filtered trajectory.

[053] An exemplary diagram showing the step 402B of preprocessing the raw GPS da ta to obtain the filtered trajectory is depicted in Figure 5. In some embodiments, during the preprocessing, the raw GPS data can be first processed to remove duplicate GPS pings and rearranged to become time-ordered. Additionally, as the raw GPS pings are usually very noisy when a driver is close to a location of origin and a location of destina tion due to slow speed around these areas, the present application advantageously ad dresses this technical problem by filtering GPS pings of the historical trajectory from the location of origin until a distance to the location of origin is larger than a threshold. In this manner, as shown in Figure 5, the GPS pings near the location of origin are filtered, and a location of a first GPS ping that lies outside a threshold radius is obtained as an in ferred location of origin. Likewise, the GPS pings near the location of destination are fil tered and an inferred location of destination is obtained.

[054] As shown in Figure 5, by virtue of the preprocessing of the raw GPS data at step 402B, the preprocessing module 204 obtains a filtered trajectory with an inferred location of origin and an inferred location of destination. To differentiate the location of origin be fore and after pre-processing in Figure 5, the original location of origin is labelled as raw origin and the inferred location of origin is labelled as inferred origin. Similarly, the origi nal location of destination is labelled as raw destination and the inferred location of des tination is labelled as inferred destination in Figure 5.

[055] As described above, the pre-processed GPS data, i.e. the filtered trajectory with the inferred location of origin and the inferred location of destination, can be used in the routing-metric computation module 210 to evaluate suggested routes suggested by the route engine module 208. The evaluation result produced by the routing-metric computa tion module 210 can further be used for downstream applications, e.g. vehicular route learning.

[056] The filtered trajectory comprises a time-ordered sequence of GPS pings and each of the GPS pings indicates a location of a vehicle at a timestamp during the filtered trajectory. Such a time-ordered sequence of GPS pings is indicative of the vehicle’s ac tual route. Such a vehicle’s actual route is referred as a ground truth route. At step 402C, the ground truth generator module 206 converts the time-ordered sequence of GPS pings to a ground truth route.

[057] In some embodiments, when converting the time-ordered sequence of GPS pings at step 402C, the ground truth generator module 206 maps the time-ordered se quence of GPS pings to most similar road segments on the map. The mapped most similar road segments forms a sequence of nodes in the map. In this manner, the time- ordered sequence of GPS pings is mapped to a sequence of nodes in the map.

[058] During the mapping of the time-ordered sequence of GPS pings, each GPS ping can be mapped into several candidate road segments through R-tree. Thereafter, a pro cess is conducted to find most similar road segments for the sequence of GPS pings through a hidden Markov model.

[059] In some alternative embodiments, the ground truth generator module 206 may include a map matching module that is configured to map the time-ordered sequence of GPS pings to a sequence of nodes in the map as described above. An example of the map matching module is depicted in Figure 3.

[060] In some embodiments, the mapped sequence of nodes in the map may include certain consecutive nodes that are only routable but are not directly connected in the map. To increase connectivity of the sequence of nodes, the step 402C of converting the time-ordered sequence of GPS pings to a ground truth route can further requires the ground truth generator module 206 to check connectivity of every two consecutive nodes in the sequence of nodes. If there are two consecutive nodes in the sequence of nodes which are not connected in the map, the ground truth generator module 206 can identify a path, which includes two or more nodes, interconnecting the two consecutive nodes in the map, and stitch the two consecutive nodes by inserting the two or more nodes be tween the two consecutive nodes.

[061] In some alternative embodiments, the ground truth generator module 206 may include a stitcher module that is configured to check connectivity of every two consecu tive nodes in the sequence of nodes, and if there are two consecutive nodes in the se quence of nodes which are not connected in the map, identify a path which includes two or more nodes interconnecting the two consecutive nodes in the map, and stitch the two consecutive nodes by inserting the two or more nodes between the two consecutive nodes. An example of the stitcher module is depicted in Figure 3. [062] In some examples, the ground truth generator module 206 or the stitcher module may identify the path by finding one and only one route between two disconnected con secutive nodes, e.g. from node a to node b, either in an original map or in a simplified map which treats certain group of nodes (such as junctions) as one node. In either of the maps, the ground truth generator module 206 or the stitcher module inserts nodes along the one and only one route into the gap between node a and node b to make sure the node sequence from node a to node b becomes fully connected.

[063] Experimental data of the present application shows that the connectivity of the mapped sequence of nodes can be significantly boosted after the steps described above for increasing connectivity by stitching disconnected consecutive nodes at the ground truth generator module 206 or the stitcher module. For example, for historical trajectories captured over one day, connectivity of over 30% of total node sequences converted from preprocessed historical trajectories can be improved by the stitching. Ground truth routes formed by such processed node sequences can in turn facilitate accurate evaluation for improving the routing.

[064] In view of the above, after stitching certain disconnected consecutive nodes in the mapped sequence of nodes, the stitched mapped sequence of nodes forms a ground truth route. It is appreciable to those skilled in the art that in some other embodi ments, the mapped sequence of nodes may form a ground truth route without stitching.

[065] At step 404, routing metrics computation module 210 obtains a suggested route generated based on the inferred location of origin and the inferred location of destination. In some embodiments, the suggested route is obtained from the route engine module 208, and the step 404 comprises the following sub-steps:

- Step 404A: building a road network based on the map and a speed profile of the map, the speed profile comprising a collection of speeds, each speed corre sponding to a road class in the map; and

- Step 404B: generating the suggested route based on the road network, the in ferred location of origin and the inferred location of destination.

[066] At step 404A, the route engine module 208 builds a road network based on the map and a speed profile of the map. As described above, the speed profile comprises a collection of speeds each of which is corresponding to a road class in the map. [067] In some embodiments, the map may include 12 or 15 road classes. In this re spect, the speed profile may comprise a collection of 12 or 15 speeds each correspond ing to a respective road class in the map.

[068] In some embodiments, when building the road network at step 404C, the weight of each road segment in the road network is the duration of each road segment and is inferred based on the map and the speed profile along with an auxiliary data structure in support of different queries (e.g., R-tree is generated to support nearest road segment query).

[069] In some embodiments, the route engine module 208 may include a mapper mod ule that is configured to build a road network as described above. An example of the mapper module is depicted in Figure 3.

[070] At step 404B, the route engine module 208 generates a suggested route based on the road network, the inferred location of origin, and the inferred location of destina tion.

[071] In some embodiments, the step 404B includes a sub-step at which the route en gine module 208 matches the inferred location of origin and the inferred location of des tination to nearest road segment as an origin road segment and a destination segment. Such a matching is similar to the mapping from the time-ordered sequence of GPS pings to the sequence of nodes as described in step 402C. In some examples, the route en gine module 208 may include a mapper module that is configured to conduct the match ing. An example of the mapper module is depicted in Figure 3.

[072] Thereafter, the step 404B includes another sub-step at which the route engine module 208 produces a suggested route connecting the origin segment and the destina tion segment with a shortest weight (duration). Various algorithms can be used for com puting a single source shortest path, such as Dijkstra’s algorithm or A * search. The pre sent route engine module 208 uses a contraction hierarchies algorithm for its ability to handle millions of shortest path queries efficiently after the preprocessing at step 402B.

[073] In the present application, the above described step 402C that converts the time- ordered sequence of GPS pings to a ground truth route can take place either prior to, in parallel with, or after the steps 404A and 404B for building a road network and generat- ing a suggested route based on the road network and inferred locations of origin and destination.

[074] At step 406, the routing metrics computation module 210 quantifies a deviation of the suggested route from the ground truth route by calculating an offcourse ratio based on a combined length of road segments in the suggested route that are matched to cor responding road segments in the ground truth route and a combined length of road seg ments in the ground truth route.

[075] In some embodiments, when calculating the offcourse ratio at step 406, the rout ing metrics computation module 210 is configured to compute the following equation: wherein P is the suggested route, P is the ground truth route, is a simi- larity score between the suggested route and the ground truth route.

[076] In some embodiments, the similarity score Sim P, can be computed based on the following equation: wherein e denotes each road segment in the ground truth route, len(e) denotes each road segment’s length in the ground truth route, and SequentialOverlap (P,P) is the combined length of road segments in the suggested route that are matched to the corre sponding road segments in the ground truth route.

[077] In some embodiments, the step 406 may include a sub-step for obtaining the combined length SequentialOverlap (P,P) of road segments in the suggested route that are matched to the corresponding road segments in the ground truth route. At the sub step of step 406, the routing metrics computation module 210 is configured to search for the road segments in the suggested route that are matched to the corresponding road segments in the ground truth route. [078] At the sub-step of searching for the road segments, the routing metrics computa tion module 210 sequentially conducts a search for a matching road segment in the for each road segment in the suggested route, wherein during each iteration of search, the routing metrics computation module 210 starts the search in the ground truth route from a road segment that is placed subsequent to a last matched road segment in the sug gested route.

[079] Figure 6 shows an exemplary method 600 that can be used in the sub-step of step 406 for obtaining the combined length of road segments in the suggested route that are matched to road segments in the ground truth route. The exemplary method 600 is presented in the form of an algorithm.

[080] As shown in Figure 6, the method 600 receives the ground truth route and the suggested routes as inputs and produces a combined length of overlapped road seg ments as an output.

[081] As shown in line 1 of Figure 6, the method 600 starts searching for a matching road segment in the ground truth route for the first road segment of the suggested route. The searching starts from the first road segment in the ground truth route. The initial length of overlapped segments is set as 0, as shown in line 2 of Figure 6.

[082] As shown in lines 3 and 4 of Figure 6, the method 600 iterates each road seg ment in the suggested route and searches for a matching road segment in the ground truth route.

[083] If a road segment of the suggested route finds a matching road segment in the ground truth route as shown in line 5 of the method 600, the length of the road segment of the suggested route is added to the length of overlapped segments, as shown in line 6 of the method 600. In the next iteration as shown in line 7 of Figure 6, the search starts from the next road segment in the ground truth route to make sure that the road seg ments in the suggested route and the ground truth route are sequentially matched.

[084] If no matching road segment is found for the road segment of the suggested route, a function FirstMatch returns a negative index indicating no match and proceeds to a search for the next road segment of the suggested route, as shown in line 9 of Fig ure 6. [085] The route deviation quantification as obtained in the embodiments of method and device as described above provides two-fold technical advantages: first, the off- course ratio calculated by the route deviation quantification is more directly indicative of a difference between a suggested route and a ground truth route, as the more and long er road segments the suggested route shares with the ground truth route, the more simi lar the two routes are; second, the offcourse ratio calculated by the route deviation quan tification is more accurate, as the obtaining of the combined length SequentialOverlap

(P,P) of road segments in the suggested route that are matched to road segments in the ground truth route is accurate. This is because the overlap of the suggested route and the ground truth route must be sequential as the sequences of road segments in the two routes are connected in a timely manner.

[086] Furthermore, the route deviation quantification as obtained in the embodiments of method and device as described above provides flexibility for route deviation quantifica tion. As shown in equations (1) and (2), a deviation between any two sequences of road segments can be calculated by the route deviation quantification of the present applica tion, regardless of whether the two sequences of road segments are fully connected.

[087] Based on the equation (1 ), the offcourse ratio calculated by the route deviation quantification falls between 0 and 1 , wherein 0 means the two routes are completely the same, and 1 means the suggested route is completed deviated from the ground truth route. That is, the smaller the offcourse ratio is, the closer the suggested route is to the ground truth ratio. The offcourse ratio, as a value evaluating a deviation of a suggested route generated by the route engine module 208 compared to a ground truth route, can be subsequently used in downstream applications for improving the routing.

[088] In some embodiments, the routing metrics computation module 210 can store the offcourse ratio to a database corresponding to the suggested route with the inferred lo cation of origin and the inferred location of destination. The database can be the data base module 202 of the device 200 or a database module 702 in a system 700 for ve hicular route learning as described herein, or a database module 802 in a system 800 for vehicular route learning as described herein.

[089] In some embodiments, if the offcourse ratio is not greater than a threshold value, the routing metrics computation module 210 can store the suggested route with the in ferred location of origin and the inferred location of destination in the data module 202 of the device 200. In response to a routing request received at the acquisition module 201 with a location of origin corresponding to the inferred location of origin and a location of destination corresponding to the inferred location of destination, the device 200 may out put the suggested route to a route engine module 212 for providing as a suggested route in response to the routing request. The threshold value can be pre-determined based on practical needs, e.g. 0.2.

[090] In some embodiments, if the offcourse ratio is greater than a threshold value, the routing metrics computation module 210 can send the offcourse ratio to a downstream application, e.g. a system for vehicular route learning, for optimising the speed profile of the map to rebuild the road network for regenerating the suggested route to achieve a minimised offcourse ratio. Additionally or alternatively, vehicular route learning is an in dependent process which can be triggered on demand or in a batch depending on vari ous requirements, instead of being triggered by an offcourse ratio greater than a thresh old value.

[091] Figure 3 shows another embodiment of a device 300 for route deviation quantifi cation module. Similar to the device 200 as shown in Figure 2, the device 300 comprises a preprocessing module 302, a ground truth generator module 332, a route engine mod ule 334 and a routing metrics computation module 312. As described above, the device 300 is configured to perform the steps shown in Figure 4 and described above.

[092] In the embodiment of the device 300, the ground truth generator module 332 in cludes two sub-modules: a map matching module 304 and a stitcher module 306.

[093] In the embodiment of the device 300, the route engine module 334 includes two sub-modules: a mapper module 308 and a route engine 310.

[094] At step 402, the routing metrics computation module 312is configured to obtain a ground truth route based on a filtered trajectory. The filtered trajectory includes an in ferred location of origin and an inferred location of destination. In some embodiments, the ground truth route is obtained from the ground truth generator module 332.

[095] At a sub-step of step 402, the map matching module 304 maps the time-ordered sequence of GPS pings to a sequence of nodes in the map as described above with re spect to Figure 4. [096] At another sub-step of step 402, the stitcher module 306 checks connectivity of every two consecutive nodes in the sequence of nodes, and if there are two consecutive nodes in the sequence of nodes which are not connected in the map, identify a path which includes two or more nodes interconnecting the two consecutive nodes in the map, and stitch the two consecutive nodes by inserting the two or more nodes between the two consecutive nodes.

[097] At step 404, the routing metrics computation module 312 is further configured to obtain a suggested route generated based on the inferred location of origin and the in ferred location of destination. In some embodiments, the suggested route is obtained from the route engine module 334.

[098] At step 406, the routing metrics computation module 312is configured to quantify a deviation of the suggested route from the ground truth route by calculating an off- course ratio based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the ground truth route and a combined length of road segments in the ground truth route.

[099] As described above, the offcourse ratio calculated by route deviation quantifica tion as described above is used as an evaluation metric for vehicular route learning. Giv en a map, the topology of the road network and the road class of each road segment is fixed. Therefore, the vehicular route learning in the present application is formulated as identifying an optimal speed of each road segment in a road network. As described above, vehicular route learning is an independent process which can be triggered on demand or in a batch depending on various requirements, which may or may not be trig gered by an offcourse ratio greater than a threshold value.

[0100] A road network may comprise millions of road segments. Directly inferring speeds for millions of road segments via exhaustive enumeration is intractable and costs considerable computation bandwidth of a computing system. To address this data vol ume issue, the present applications assigns a same speed to road segments with a same road class. In this manner, as the number of road classes in a map is limited (e.g. usually less than 15), the vehicular route learning of the present application that finds an optimal speed of each road class can significantly reduce computational pressure and improve learning performance. The optimised speed identified by the vehicular route learning of the present application is not a real speed but a routing weight for generating an optimal route.

[0101] Figure 7 shows an embodiment of a system 700 for vehicular route learning. The architecture of the system 700 utilises the structure of the device 200 for route deviation quantification as shown in Figure 2.

[0102] The system 700 includes a pre-processing module 704, a ground truth generator module 706, a routing metrics computation module 710 and a routing weight tuning module 714.

[0103] Figure 8 shows another embodiment of a system 800 for vehicular route learning. The system 800 includes a routing metrics computation module 804, an aggregation and average calculation module 806, a routing metrics comparator module 808, a routing weight optimisation module 810 and a route engine module 812.

[0104] In some embodiments, the system 800 for vehicular route learning can be im plemented as the routing weight tuning module 714 in the system 700.

[0105] Figure 9 shows an embodiment method 900 for vehicular route learning. The method 900 comprises the following steps that can be performed by the system 700 and 800 as well as the computing device 200 implemented as a system for vehicular route learning:

- Step 902: retrieving a training data set corresponding to historical trajectories on a map;

- Step 904: optimising a speed profile of the map to achieve a minimised average offcourse ratio for the training data set; and

- Step 906: updating the speed profile for the map.

[0106] At step 902, the routing weight tuning module 714 is configured to retrieve a training data set corresponding to historical trajectories on a map. In some embodiment, the training data can be constructed prior to step 902 and comprises a collection of data points. Each data point corresponds to a historical trajectory on the map and contains an inferred location of origin of the historical trajectory, an inferred location of destination of the historical trajectory, a suggested route connecting the inferred location of origin and the inferred location of destination generated based on the map and the speed profile, and a corresponding ground truth route of the historical trajectory.

[0107] In some embodiments, a training data set can be presented as D, which com- prises a set of data points where each data point d =< l 0 , l d ,P, P > contains a loca tion of origin l 0 and a destination l d , along with a suggested route P connecting the two locations and a ground truth route P. The suggested route P and the ground truth route

P can be obtained in accordance with the method 400 for route deviation quantification as described above with respect to Figure 4.

[0108] In some embodiments, the training data can be constructed by a database mod ule 712 in the system 700 connected to the routing metrics computation module 710 that receives offcourse ratios along with inferred locations of origin, inferred locations of des tination, ground truth routes, and suggested routes connecting the inferred locations of origin and the inferred locations of destination that are generated by the routing metrics computation module 710, the preprocessing module 704, the ground truth module 706 in a pre-determined period of time.

[0109] In some embodiments, the training data can be constructed by a database mod ule 802 in the system 800 connected to a device (not shown in Figure 8) for route devia tion quantification or the memory module 104 of the device 100 when implemented as a system for vehicular route learning, in a similar manner as the a database module 702.

[0110] As described above, the pre-determined period of time can be, e.g. 8AM to 10AM every day in a predetermined month, or 5PM to 8PM every Friday in a predetermined year. It is up to the practical needs to design such a pre-determined period of time for receiving sufficient data for the vehicular route learning.

[0111] Prior to step 902, a database module 702 in the system 700 or the memory mod ule 104 can be configured to partition historical data into a plurality of training data sets that include the extracted training data set. The historical data comprises raw GPS data of historical trajectories stored in the database module 702 or the memory module 104. Each training data set in the plurality of training data sets comprises data points corre sponding to historical trajectories captured in a pre-determined hour of a day on the map. As mentioned above, the pre-determined hour can be 8AM to 9AM, 5PM to 6PM, or any hour depending on the practical needs.

[0112] Due to hyper-localization of traffic conditions in different countries or cities, ve hicular route learning by hour has advantages over learning by peak or non-peak hour as it is difficult to specify an exact period of peak hours for each city due to time zone and traffic regulations and traffic patterns in each country. By partitioning the training da ta by hour, data size of each hour bucket is reduced significantly for big cities and it ad vantageously becomes convenient to scale the vehicular route learning, as learning by hour can take place in parallel. In this approach, the training data set for non-peak hours is upsampled to make sure the data size is balanced over each hour.

[0113] Thereafter, the preprocessing module 704 or the processor module 102 prepro cesses the raw GPS data of the historical trajectories to obtain filtered trajectories with the locations of origin and the locations of destination. Each of the filtered trajectories comprises a time-ordered sequence of GPS pings. Each of the GPS pings indicates a location of a vehicle at a timestamp during the filtered trajectory.

[0114] In some embodiments, step 902 includes a sub-step at which the preprocessing module 704 or the processor module 102 constructs a speed profile, wherein the speed profile comprises a collection of speeds, each speed corresponding to a road class in the map.

[0115] In some embodiments, the preprocessing module 704 or the processor module 102 aggregates the raw GPS data of the historical trajectories to determine a historical speed for each road class in the map so as to construct the speed profile. Thereafter, the route engine module 708 or the processor module 102 builds a road network based on the speed profile and the map.

[0116] Thereafter, for each of the filtered trajectories, the ground truth generator module 706 or the processor module 102 converts the time-ordered sequence of GPS pings to the ground truth route in the training data set.

[0117] At step 904, the routing weight tuning module 714, the routing metrics computa tion module 804 or the processor module 120 optimises the speed profile of the map to achieve a minimised average offcourse ratio for the training data set. In some embodi ments, step 904 includes the following sub-steps 904A, 904B and 904C. [0118] At step 904A, the routing weight tuning module 714, the routing metrics computa tion module 804 or the processor module 120 calculates an offcourse ratio for each sug gested route in the training data set to quantify a deviation between the suggested route and the corresponding ground truth route based on a combined length of road segments in the suggested route that are matched to corresponding road segments in the corre sponding ground truth route and a combined length of road segments in the correspond ing ground truth route.

[0119] At step 904A, the calculation of the offcourse ratio for each suggested route in the training data set is according to the steps as described in the method 400 for route deviation quantification.

[0120] At step 904B, the routing weight tuning module 714, the aggregation and average calculation module 806 aggregates calculated offcourse ratios and determines an aver age offcourse ratio for all the suggested routes in the training data set.

[0121] At step 904D, for each road class in the map, the routing weight tuning module 714, the routing metrics comparator module 808 working together with the routing weight optimisation module 810, or the processor module 102 optimises the corresponding speed to identify an optimised speed that enables the route engine generator module to regenerate suggested routes for inferred locations of origin and inferred locations of des tination in the training data set with a minimised average offcourse ratio.

[0122] As described above, the vehicular route learning process minimises the average offcourse ratio over the training data set D so as to not overfit on a single route. As the size of the training data set D is sufficiently large (in practice, the size of the training da ta set D is usually in millions), the sample routes captured in the training data set D will cover all the road segments on a map and the road segment weight learned will reflect an optimal route between any two nodes on the map.

[0123] In this manner, the vehicular route learning is modelled to find an optimal road network G that has a minimised average offcourse ratio, i.e.

[0124] An embodiment of the vehicular route learning model as defined in equation (3) is depicted in Figure 10 and described in the corresponding paragraphs.

[0125] At step 906, the routing weight tuning module 714, the routing metrics compara tor module 808, or the processor module 102 updates the speed profile with optimised speeds of the corresponding road classes as obtained in step 904.

[0126] In some embodiments, in response to a routing request received at an acquisition module 701 of the system 700 with a location of origin corresponding to one of the in ferred locations of origin and a location of destination corresponding to one of the in ferred locations of destination, the system 700 may generate and output a suggested route based on the map and the updated speed profile in response to the routing request.

[0127] In some embodiments, when a routing request is received, based on attributes specified in the request (timestamp, wheels of vehicles, cities, etc.), the route engine module in the system 700 can choose the corresponding updated speed profile to gen erate a suggested route and output the suggested route to a user’s device (not shown).

[0128] Validation of the vehicular route learning as shown in Figure 9 can be carried out over a data set constructed from historical data captured in a different period of time compared to the training data set. For example, as the vehicular route learning is com pleted and an updated speed profile is obtained for a particular map, a validation pro cess can be performed as follows.

[0129] First, the routing weight tuning module 714, the routing metrics computation module 804 or the processor module 120 retrieves a validation data set (obtained in a similar manner and in the same format as the training data set, based on historical data captured in a different period of time in the same city) that is constructed for the same map.

[0130] Thereafter, the routing weight tuning module 714, the routing metrics computa tion module 804 or the processor module 120 calculates an offcourse ratio for each sug gested route in the validation data set according to the steps as described in the method 400 for route deviation quantification, aggregates the calculated offcourse ratios and de- termines an average offcourse ratio for all the suggested routes in the validation data set in a manner as described with respect to step 904B. The steps of calculation, aggrega tion and determination of the average offcourse ratio for all the suggested routes in the validation data set are conducted with an original speed profile of the map and the up dated speed profile of the map.

[0131] Subsequently, the routing weight tuning module 714, the routing metrics compu tation module 804 or the processor module 120 compares the average offcourse ratio for all the suggested routes in the validation data set obtained using the original speed pro file of the map and the average offcourse ratio for all the suggested routes in the valida tion data set obtained using the updated speed profile of the map.

[0132] If the average offcourse ratio for all the suggested routes in the validation data set obtained using the updated speed profile of the map is smaller than the validation data set obtained using the original speed profile of the map, the process of vehicular route learning as shown in Figure 9 is validated to be successful.

[0133] On the other hand, if the average offcourse ratio for all the suggested routes in the validation data set obtained using the updated speed profile of the map is not smaller than the validation data set obtained using the original speed profile of the map, a new training data set can be constructed and retrieved by the routing weight tuning module 714, the routing metrics computation module 804 or the processor module 120 for re peating steps 902 to 906 of the process 900 of vehicular route learning.

[0134] Figure 10 illustrates an embodiment of a method 1000 for optimising speed for each road class in the map. This method includes sub-steps 1002 to 1016 that can be used in step 904 of the method 900.

[0135] As shown in Figure 10, the step 904 can include a sub-step 1002 in which the routing weight tuning module 714, the routing metrics comparator module 808, or the processor module 102 compares whether the determined average offcourse ratio for all the suggested routes in the training data set is greater than an existing average off course ratio of the map.

[0136] If the comparison at sub-step 1002 indicates that the determined average off course ratio for all the suggested routes in the training data set is not greater than the existing average offcourse ratio of the map, the routing weight tuning module 714, the routing metrics comparator module 808, or the processor module 102 identifies the cor responding speed as the optimised speed for the road class at sub-step 1004. At sub step 1004, the speed profile can be accordingly updated with the optimised speed. The determined average offcourse ratio and the updated speed profile can be stored at the database module 702, 802 or the memory module 104. The existing averaged off-course value can be overwritten with the determined average offcourse ratio in the database module 702, 802 or the memory module 104.

[0137] Subsequent to sub-step 1004, the routing weight tuning module 714, the routing weight optimisation module 810, or the processor module 102 can continue to adjust the corresponding speed of the road class at sub-step 1006 to search for potential better result.

[0138] On the other hand, if the comparison at sub-step 1002 indicates that the deter mined average offcourse ratio for all the suggested routes in the training data set is greater than the existing average offcourse ratio of the map, the routing weight tuning module 714, the routing weight optimisation module 810, or the processor module 102 adjusts the corresponding speed of a road class in the speed profile at sub-step 1006.

[0139] Subsequent to sub-step 1006, at sub-step 1008, the routing weight tuning mod ule 714, the route engine module 812, or the processor module 102 builds a road net work based on the map and the adjusted speed profile having the adjusted correspond ing speed.

[0140] Subsequent to sub-step1008, at sub-step 1010, the routing weight tuning module 714, the route engine module 812, or the processor module 102 provides the road net work, the inferred locations of origin and the inferred locations of destination to the route engine module to regenerate suggested routes.

[0141] Subsequent to sub-step1010, at sub-step 1012, the routing weight tuning module 714, the routing metrics computation module 804, or the processor module 102 recalcu lates an offcourse ratio for each regenerated suggested route to quantify a deviation be tween the regenerated suggested route and the corresponding ground truth route.

[0142] Subsequent to sub-step1012, at sub-step 1014, the routing weight tuning module 714, the aggregation and average calculation module 806, or the processor module 102 aggregates recalculated offcourse ratios and determine an average offcourse ratio for all the regenerated suggested routes.

[0143] Subsequent to sub-step1014, at sub-step 1002’, the routing weight tuning module 714, the routing metrics comparator module 808, or the processor module 102 compares whether the determined average offcourse ratio for all the regenerated suggested routes is greater than the existing average offcourse ratio of the map.

[0144] Subsequent to sub-step 1002’, if the comparison at sub-step 1002’ indicates that the determined average offcourse ratio for all the regenerated suggested routes is great er than the existing average offcourse ratio of the map, the routing weight tuning module 714, the module 804, 806, 808, 810 or 812 in the system 800, or the processor module 102 iterates adjusting the corresponding speed of the road class, as depicted in sub steps 1006’, 1008’, 1010’, 1012’ and 1014’.

[0145] Subsequent to sub-step 1002’, if the comparison at sub-step 1002’ indicates that the determined average offcourse ratio for all the regenerated suggested routes is not greater than the existing average offcourse ratio of the map, the routing weight tuning module 714, the routing metrics comparator module 808, or the processor module 102 identifies the adjusted corresponding speed as the optimised speed for the road class at step 1004’. At sub-step 1004’, the speed profile can be accordingly updated with the op timised speed. The determined average offcourse ratio and the updated speed profile can be stored at the database module 702, 802 or the memory module 104. The existing averaged off-course value can be overwritten with the determined average offcourse ra tio in the database module 702, 802 or the memory module 104.

[0146] Subsequent to sub-step 1004’, the routing weight tuning module 714, the routing weight optimisation module 810, or the processor module 102 can continue to adjust the corresponding speed of the road class at sub-step 1006’ to search for potential better result, and iterate the steps as depicted in sub-steps 1008’, 1010’, 1012’ and 1014’.

[0147] If after the iteration of sub-steps of 1006’, 1008’, 1010’, 1012’ and 1014’, the comparison at sub-step 1002’ indicates that the average offcourse ratio determined at step 1014’ for all the regenerated suggested routes based on the speed adjusted in step 1006’ is not greater than the existing average offcourse ratio of the map, the routing weight tuning module 714, the routing metrics comparator module 808, or the processor module 102 can at sub-step 1016 identify the average offcourse ratio determined at step 1014’ as a minimised average offcourse ratio for the training data set and identify the speed adjusted in step 1006’ as the optimised speed for the road class. At sub-step 1016, the speed profile can be accordingly updated with the optimised speed. The mini mised average offcourse ratio and the updated speed profile can be stored at the data base module 702, 802 or the memory module 104.

[0148] Figure 11 shows an exemplary method 1100 that also can be used as sub-steps in step 904 for optimising speed for each road class in the map. The exemplary method 1100 is presented in the form of an algorithm.

[0149] As shown in Figure 11 , the method 1100 includes a two-step tuning framework that receives a training data set D, a map, and a speed profile as inputs and produces an optimised speed profile as an output.

[0150] As shown in line 1 of Figure 11 , the method 1100 starts iterating optimising each road class and its corresponding speed to obtain an optimal speed s for each road class sequentially. At the beginning of a first iteration, a smallest speed s_MIN of a road class is set as an initial speed of the road class, as shown in line 2 of Figure 11 . As shown in line 3 of Figure 11 , an initial average offcourse ratio is calculated for the training data set D based on the map and a speed profile with the initial speed of the road class.

[0151] For each road class, an optimal speed is obtained via a grid search with two sweeps. As shown in lines 4 to 7 of Figure 11 , at the first step the system 700, 800 or the processor module 102 finds a region where the optimal speed is achieved using iteration of speed adjusting by a large step of length. As shown in lines 9 to 12 of Figure 11 , at the second step, the system 700, 800 or the processor module 102 uses a small step of length for iteration of speed adjusting to find the final optimal speed with a smallest off course ratio.

[0152] For example, in the second step, the surrounding possible values s * are gone through to further tune the optimal speed s obtained in the first step. In an alternative embodiment of the step step, line 8 of Figure 11 can be changed to “s* <— max(s-A, s_MIN)” and line 9 of Figure 11 can be changed to “while s * < min (s_MAX, s + D) do”. This change can avoid potential situations when a tuned surrounding possible value s * goes beyond predefined min and max values. If after the first step, the optimal speed s is equal to s_MIN, in the second step, the method 1100 will only examine the range be tween s_MIN to s_MIN + D.

[0153] For example, s_MIN can be set as 8 km/h, and s_MAX can be set as 100 km/h. In an embodiment, in the first step, the large step of length (step 1) can be set as step 1 = 10 km/h. In this manner, an optimal speed can be obtained at the first step at s = 58 km/h. Subsequently in the second step, we set a range D for tuning surrounding possible values s * of the optimal speed s as D = 10 km/h and the small step of length as step_2 = 1 km/h. In this manner, the surrounding possible values s * of the optimal speed are ex amined from s - D (i.e. 58 - 10 = 48 km/h) to s + D (i.e. 58 + 10 = 68 km/h). In this man ner, a final optimal speed s * = 63 km/h is identified with a minimum average offcourse ratio.

[0154] When a CalcRatioAndCompare function as mentioned in lines 3, 6 and 11 of Fig ure 11 is performed, the system 700, 800 or the processor module 102 rebuilds a road network based on the map and a new speed profile, regenerates suggested routes on the rebuilt road network based on the locations of origin and destination, and calculates an average offcourse ratio for the regenerated suggested routes compared to the ground truth routes. The system 700, 800 or the processor module 102 then compares the cal culated average offcourse ratio with an existing offcourse ratio (e.g. the initial average offcourse ratio as calculated in line 3 of Figure 11 ), picks whichever is smaller, and overwrites the existing average offcourse ratio with the corresponding speed, as shown in line 13 of Figure 11 .

[0155] In implementing the two-step tuning framework of Figure 11 , it is observed that the order of road class optimisation has little impact on the final speed profile optimising result. Therefore, it can be seen that the speed of each road class is independent, which can in turn significantly reduce a solution space.

[0156] Figure 12 shows an example diagram 1200 depicting a relationship between off course ratio and road class speed without optimisation. This relationship can be obtained during implementation of the method 1100 for optimising speed for each road class in a map as exemplified in Figure 11 .

[0157] As shown in Figure 12, the relationship between road class speed and offcourse ratio is near unimodal. In Figure 12, the speed of two particular road classes (e.g. mo torway and secondary road in Bangkok) are plotted with step length equals to 1 . The cor- responding offcourse ratio is then calculated according to steps as shown in Figure 3. In this manner, a relationship curve 1202 for motorway road and a relationship curve 1204 for secondary road are obtained. It can be observed from relationship curves 1202, 1204 that there is one optimal speed for each road class, however there are multiple local op tima, as the respective relationship curve 1202, 1204 is not smooth. The not smooth curve can be addressed in two sweeps by the two-step tuning framework in Figure 11 . In the first sweep (interchangablely referred as the first step), as the step length is large, a region with an optimal value is likely to be located. In the second sweep (interchangable ly referred as the second step), the global optimum will be found with small steps within a tuning range d >= step 1 . There are situations where global optimum cannot be found in the first sweep and consequently returns a sub-optimal speed, but it is accepta ble as the main focus for vehicular route learning is to improve the average offcourse ratio. Additionally, the two-step tuning framework in Figure 11 runs much faster com pared to an exhaustive search of all solution space with small steps.

[0158] Figure 13 is a block diagram of a parallel computing system 1300 suitable for use in implementation of the methods and devices for route deviation quantification as ex emplified in Figures 1 to 6 and/or the methods and systems for vehicular route learning as exemplified in Figures 7 to 11 .

[0159] As described above, the computation of route deviation quantification can be conducted independently for each historical trajectory. Similarly, vehicular route learning is optimised based on each training data set, therefore different training data sets can be processed in parallel.

[0160] As shown in Figure 13, raw GPS data is firstly partitioned by a predefined parti tion key for indexing. Partition keys include year, month, day, hour, city and wheels of vehicle, as traffic conditions and routing preferences are different among cities and vary between cars and motorbikes.

[0161] Thereafter, the partitioned data is aggregated into each task. The aggregation strategy depends on the type of task, for instance, routing-metrics computation, e.g. route deviation quantification usually aggregate each day’s GPS data whereas vehicular route learning can require weeks of GPS data that is partitioned by hour. [0162] Subsequently, the respective tasks can be allocated to respective machines equally by data size and run in parallel in each machine.

[0163] Figure 14 is a block diagram of a computer system 1400 suitable for use as a device for route deviation quantification as shown in Figures 2 to 3 and/or a system for vehicular route learning as shown in Figures 7 to 8.

[0164] The following description of the computer system / computing device 1400 is pro vided by way of example only and is not intended to be limiting.

[0165] As shown in Figure 1400, the example computing device 1400 includes a pro cessor 1404 for executing software routines. Although a single processor is shown for the sake of clarity, the computing device 1400 may also include a multi-processor sys tem. The processor 1404 is connected to a communication infrastructure 1406 for com munication with other components of the computing device 1400. The communication infrastructure 1406 may include, for example, a communications bus, cross-bar, or net work.

[0166] The computing device 1400 further includes a main memory 1408, such as a random access memory (RAM), and a secondary memory 1410. The secondary memory 1410 may include, for example, a hard disk drive 1412 and/or a removable storage drive 1414, which may include a magnetic tape drive, an optical disk drive, or the like. The re movable storage drive 1414 reads from and/or writes to a removable storage unit 1418 in a well-known manner. The removable storage unit 1418 may include a magnetic tape, optical disk, or the like, which is read by and written to by removable storage drive 1414. As will be appreciated by persons skilled in the relevant art(s), the removable storage unit 1418 includes a computer readable storage medium having stored therein computer executable program code instructions and/or data.

[0167] In an alternative implementation, the secondary memory 1410 may additionally or alternatively include other similar means for allowing computer programs or other in structions to be loaded into the computing device 1400. Such means can include, for ex ample, a removable storage unit 1422 and an interface 1420. Examples of a removable storage unit 1422 and interface 1420 include a removable memory chip (such as an EPROM or PROM) and associated socket, and other removable storage units 1422 and interfaces 1420 which allow software and data to be transferred from the removable storage unit 1422 to the computer system 1400. [0168] The computing device 1400 also includes at least one communication interface 1424. The communication interface 1424 allows software and data to be transferred be tween computing device 1400 and external devices via a communication path 1426. In various embodiments, the communication interface 1424 permits data to be transferred between the computing device 1400 and a data communication network, such as a pub lic data or private data communication network. The communication interface 1424 may be used to exchange data between different computing devices 1400 which such com puting devices 1400 form part an interconnected computer network. Examples of a communication interface 1424 can include a modem, a network interface (such as an Ethernet card), a communication port, an antenna with associated circuitry and the like. The communication interface 1424 may be wired or may be wireless. Software and data transferred via the communication interface 1424 are in the form of signals which can be electronic, electromagnetic, optical or other signals capable of being received by com munication interface 1424. These signals are provided to the communication interface via the communication path 1426.

[0169] Optionally, the computing device 1400 further includes a display interface 1402 which performs operations for rendering images to an associated display 530 and an audio interface 532 for performing operations for playing audio content via associated speaker(s) 534.

[0170] As used herein, the term "computer program product" may refer, in part, to re movable storage unit 1418, removable storage unit 1422, a hard disk installed in hard disk drive 1412, or a carrier wave carrying software over communication path 1426 (wireless link or cable) to communication interface 1424. Computer readable storage media refers to any non-transitory tangible storage medium that provides recorded in structions and/or data to the computing device 1400 for execution and/or processing. Examples of such storage media include floppy disks, magnetic tape, CD-ROM, DVD, Blu-rayTM Disc, a hard disk drive, a ROM or integrated circuit, USB memory, a magne to-optical disk, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of the computing device 1400. Ex amples of transitory or non-tangible computer readable transmission media that may al so participate in the provision of software, application programs, instructions and/or data to the computing device 1400 include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or In tranets including e-mail transmissions and information recorded on Websites and the like.

[0171] The computer programs (also called computer program code) are stored in main memory 1408 and/or secondary memory 1410. Computer programs can also be re ceived via the communication interface 1424. Such computer programs, when executed, enable the computing device 1400 to perform one or more features of embodiments dis cussed herein. In various embodiments, the computer programs, when executed, enable the processor 1404 to perform features of the above-described embodiments. Accord ingly, such computer programs represent controllers of the computer system 1400.

[0172] Software may be stored in a computer program product and loaded into the com puting device 1400 using the removable storage drive 1414, the hard disk drive 1412, or the interface 1420. Alternatively, the computer program product may be downloaded to the computer system 1400 over the communications path 1426. The software, when ex ecuted by the processor 1404, causes the computing device 1400 to perform functions of embodiments described herein.

[0173] It is to be understood that the embodiment of Figure 5 is presented merely by way of example. Therefore, in some embodiments one or more features of the compu ting device 1400 may be omitted. Also, in some embodiments, one or more features of the computing device 1400 may be combined together. Additionally, in some embodi ments, one or more features of the computing device 1400 may be split into one or more component parts.

[0174] Figure 15 shows a computer system 1500 suitable for implementing the steps as required in the methods for route deviation quantification and/or the methods for vehicu lar route learning, as described above.

[0175] As shown, the computer system 1500 may include one or more computing devic es 1502, 1504 that are communicable to each other. Each of the computing devices 1502, 1504 can be configured to perform one or more steps as described in the above methods.

[0176] Each of the one or more computing devices 1502, 1504 can be implemented as a server to perform one or more steps as described above. These servers may belong to a same entity or different entities. [0177] For example, when implementing a method 400 for route deviation quantification, the steps 402, 404 and 406 may be conducted by the computing device 1502 at a same entity. In some alternative examples, the steps 402 and 404 may be conducted by the computing device 1504 at a first entity, and the ground truth route and the suggested route obtained from steps 402 and 404 may then be forwarded via a communication link 1506 to the computing device 1504 for conducting step 406 at a second entity.

[0178] The techniques described in this specification produce one or more technical ef fects. In particular, the present disclosure advantageously utilises route deviation quanti fication as a key routing metric to accurately evaluate deviation of a suggested route generated by a route engine module and a ground truth route actually taken by a driver and subsequently constructs a vehicular route learning system with customised training data sets (e.g. extract a training data set having historical data captured in a same hour of each day in a month in a particular city) utilising an offcourse ratio calculated by the route deviation quantification. In addition, the present disclosure advantageously utilises parallel computing to partition and process data for the route deviation quantification and the vehicular route learning, which allows learning from a great volume of historical data without compromising performance.

[0179] It will be appreciated by a person skilled in the art that numerous variations and/or modifications may be made to the present disclosure as shown in the specific embodiments without departing from the scope of the specification as broadly described. The present embodiments are, therefore, to be considered in all respects to be illustra tive and not restrictive.