CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] Not applicable.

[0002] Embodiments of the present disclosure relate generally to systems and methods for determining an operational path for an agricultural machine in a working environment.

BACKGROUND

[0003] It is known to perform path planning for agricultural operations in a working environment, such as a field or the like. This is often performed manually by the operator of machines working in the environment in an attempt to optimize the relevant agricultural operation in terms of efficiency and cost. More recently, systems are provided which may suggest operational paths to an operator based on the operational task, location of crop, field slope etc. however no complete solution has been provided which accounts for in-field variables such as obstacles and the like.

[0004] It would be advantageous to provide a system (and associated method) which overcomes or at least partly mitigates one or more problems associated with the prior art systems.

BRIEF SUMMARY

[0005] In an aspect of the invention there is provided a control system for planning an agricultural operation in a working environment, the control system comprising one or more controllers and being configured to: determine a boundary for the working environment; determine one or more characteristics of at least one obstacle within the working environment; determine an operational path for an agricultural machine in dependence on the boundary for the working environment and the characteristic(s) of the obstacle(s); and generate and output a control signal for controlling one or more operational components associated with the agricultural machine in dependence on the determined operational path.

[0006] Advantageously; the present invention provides a system which accounts for obstacles within the working environment when planning an operational path through that environment. This may enable the system to efficiently handle such obstacles and prevent or reduce any overlap In passes by the machine,, increasing the efficiency of the agricultural operation as a whole.

[0007] The one or more controllers may collectively comprise an input (e.g. an electronic input) for receiving one or more input signals. The one or more input signals may comprise data indicative of the boundary of the working environment, and/or the one or more characteristics of the obstacle(s) . The one or more controllers may collectively comprise one or more processors (e.g. electronic processors) operable to execute computer readable instructions for controlling operational of the control system, for example, to determine ths boundary and/or the one or more characteristics, and/or the operational path, The one or more processors may be operable to generate one or more control signals for controlling operation of the one or more operational components. The one or more controllers may collectively comprise an output (e.g. an electronic output) for outputting the one or more control signals.

[0008] In embodiments the control system may be configured to determine a base model for the operational path in dependence on the boundary only. This may consider the shape and size of the overall environment and determine therefrom one or mare aspects of the operational path, such as a general heading for ths machine within the working environment. The control system may be configured to determine one or more adjustments to the base model in dependence on the one or more obstacle characteristics. This may include determining one or more adjustments in dependence on the operational path according to the base model being intercepted by one or more obstacles.

(0009] In embodiments, the control system may be configured to determine one er more adjustments by dividing the operational path (according to the base model) at the location of the obstacle into a pre-obstacle section and a post-obstacle section. The one or more adjustments may comprise determining an obstacle operational path between the pre-obstade section and post-obstacle sections of the operational path. The obstacle operational path may include a route which bypasses the obstacle, or a route which encompasses the obstacle, for example.

[0010] The control system may be configured to classify the at least one obstacle. The control system may be configured to classify the at least one obstacle in dependence on one or more of: the she of the obstacle(s); the shape of the obstacle(s); and a relative dimension with respect to direction of travel of the agricultural machine according to the base model for the operational path.

[0011] In embodiments, the control system Is configured to determine a she of the at least one obstacle in a direction substantially perpendicular a travel direction for the machine operating in accordance with the base model for the operational path. In such embodiments, the control system may additionally bo configured to determine an adjusted operational path for the machine which bypasses the obstacle in dependence on the determined size being less than a threshold parameter. Additionally or alternatively, the control system may be configured to determine an additional headland path about the obstacle in dependence on the determined site being greater than a threshold parameter. The threshold parameter may be dependent on the width of the agricultural machine, or the width of a component suitably coupled to the machine, e.g. a header or the like. The threshold parameter may be dependent on a turning radius of the machine.

[0012] The control system may be configured to define a boundary box about the or each obstacle. The boundary box may define one or more regions of the working environment not to be traversed by the agricultural machine. The boundary box(es) may generally follow an outline or edge of the obstacle(s) and in embodiments may be offset therefrom. The offset may be determined in dependence on a turning radius of the agricultural machine.

[0013] The one or more characteristics of the obstacle(s) comprises a distance between obstacle and the boundary. The control system may be configured to compere the distance between the obstacle(s) and the boundary with a threshold distance, which may be dependent on a working width of the agricultural machine, for example. The working width may relate to a width of a header operatively coupled to the machine, for example. The control system may be configured to define a new boundary which encompasses the obstacle in dependence on the distance between obstacle and boundary being less than the threshold distance, and/or where obstacle crosses the boundary. Additionally or alternatively, the control system may be configured to define an obstacle headland path about the obstacle which is truncated so as to reduce overlap between the obstacle headland path and a headland path associated with the boundary., in dependence on the distance between obstacle and boundary being greater than the threshold distance but less than double the threshold distance, The obstacle headland path may comprise an inner obstacle headland path and an outer obstacle headland path. The control system may be configured to truncate the outer obstacle headland path at the location of any intercept between the outer headland path and a headland path associated with the boundary.

[0014] The one or more characteristics of a first obstacle may comprise a distance between the first obstacle and one or more further obstacles within the working environment. The control system may be configured to compare the distance between the first obstacle and the one er more further obstacles with a threshold distance. The threshold distance may be dependent on a working width of the agricultural machine, such as a width of a header of [or operatively coupled to} the machine, in some embodiments, the control system may be configured, in dependence on ths distance between the first obstacle and the one or more further obstacles being less than the threshold distance, to merge the first obstacle and the further obstacle(s). The control system may be configured to determine the operational path in dependence on one or more characteristics of the merged obstacle. Additionally or alternatively, the control system may he configured, in dependence on the distance between the first obstacle and the further obstacle(s) being greater than the threshold distance but less than double the threshold distance, to define a first obstacle headland path about the first obstacle and/or a further obstacle headland path about the further obstacle(s) which is truncated so as to reduce overlap between the first obstacle headland path and the further obstacle headland path.

[0015] In embodiments, the control system may be configured to retrieve obstacle data indicative of the one or more characteristics) of the obstacle from a database comprising mapped information of the working environment. Additionally or alternatively, the control system may be configured to receive obstacle data from a sensing system associated with the machine and/or or more additional machines operating within the working environment. The control system may be configured to determine the one or more characteristics of the at least one obstacle in dependence of the retrieved and/or received data.

[0016] The control system may be configured to present the determined operational path to an operator of the agricultural machine. The determined operational path may be presented on a display screen associated with the machine. Additionally or alternatively, the determined operational path may be presented on a remote device, such as a phone or tablet, for example.

[0017] Ths one or more operational components associated with the agricultural machine may comprise a steering system of the agricultural machine. The one or more operational components may comprise a propulsion system of the agricultural machine. In this way, the control system may be configured for automating motion of the machine along the determined operational path through control of the steering and/or propulsion systems. [0018] Another aspect of the invention provides a guidance system for an agricultural machine, the guidance system comprising and/or being controllable by a control system as described hereinabove.

(0019] in another aspect of the invention there is provided an agricultural machine comprising the control system and/or the guidance system of any preceding aspect,

[0020] The agricultural machine may comprise a tractor or a harvesting machine. The agricultural machine may comprise a combine harvester or a forage harvester, for exampie.

[0021] in a further aspect of the invention there is provided a method of pfenning an agricultural operation in a working environment, comprising: determining a boundary for the working environment; determining one or mor® characteristics of at ieast one obstacle within the working environment; determining an operational path for an agricultural machine in dependence on the boundary for the working environment and the characteristic(s) of the obstacle(s); and controlling one or more operational components associated with the agricultural machine In dependence on the determined operational path.

[0022] The method may comprise performing any one or more of the functionalities of th® control system described hereinabove.

[0023] A further aspect of the invention provides computer software comprising computer readable instructions which, when executed by one or more electronic processors, causes performance of a method in accordance with any aspect described herein.

[0024] A yet further aspect of the invention provides a computer readable medium having the computer software of the preceding aspect of the invention stored thereon.

[0025] Within the scop® of this application it should be understood that the various aspects, embodiments, examples and alternatives set out herein, and individual features thereof may be taken independently or in any possible end compatible combination. Where features are described with reference to a single aspect or embodiment, it should be understood that such features are applicable to all aspects and embodiments unless otherwise stated or where such features are incompatible.

BRIEF DESCRIPTION OF THE DRAWINGS

[0026] One or more embodiments of the invention / disclosure will now be described, by way of example only, with reference to the accompanying drawings, in which:

[0027] FIG. 1 is a schematic view of a control system;

[0028] FIG. 2 is a schematic view illustrating aspects of the present invention;

[0029] FIG. 3 is a flowchart illustrating an embodiment of a method of the present invention;

[0030] FIGs. 4 - 10 are a series of schematic views illustrating the operational use of aspects of the present invention.

DETAILED DESCRIPTION

[0031] The present invention, In general, relates to systems and methods for planning an agricultural operation in a working environment. As discussed herein, both a boundary for the working environment and one or more characteristics of at least one obstacle within the working environment are determined. An operational path far an agricultural machine is determined in dependence on the boundary for the working environment and the characteristic(s) of the obstacle(s). One or more operational components associated with the agricultural machine are then controlled in dependence on the determined operational path.

Control system

[0032] As discussed herein, a control system 1 is configured for controlling one or more operational components 32, 35 associated with an agricultural machine 50, such as a combine harvester or tractor or the like, in the illustrated embodiment, the controllable operational components include a guidance system 35 of a harvester 50 for controlling motion of the harvester along a determined operational path, determined in the manner discussed herein, and a user interface 32 associated with th® combine harvester 50, e.g. provided as a display terminal of the harvester 50 or indeed a handheld terminal, to provide an indication of the determined operational path for the harvester 50,

[0033] FIG 1 illustrates the control system 1 further, As shown, control system 1 comprises a controller 2 having an electronic processor 4, an electronic input 6 and electronic outputs 8, 10. The processor 4 is operable to access a memory 12 of the controller 2 and execute instructions stored therein to perform the steps and functionality of the present invention discussed herein, e.g. by controlling the user interface 32, to indicate, e.g. to an operator of the harvester 50, information indicative of the determined operational path, and/or controlling operation of the harvester 50 through generation and output of one or more control signals to a guidance system 35 thereof.

[0034] The processor 4 is operable to receive via input 6 which, in the illustrated embodiment, takas the form of input signals 5 received from a remote server 29, data indicative of a boundary for a working environment for the harvester 59 and data indicative of one or more characteristics of obstacle(s) within that environment. For instance, the server 29 can have stored therein mapped data of the environment which may, for example, be updated periodically through use of sensing systems on machines operating within that environment. In a variant, the harvester 50 may include one or more sensing systems and the control system 1 may Include an electronic input configured to receive sensor data from said systems.

[0033] Utilising the data from the server 29, the processor 4 is configured to analyse the data and determine therefrom an operational path for the harvester 50 in dependence on the boundary and the one or more characteristics of obstacle(s) within the environment. The one or more characteristics include a size and/or shape of the obstacle, e.g. with reference to a driving direction of the machine and/or with respect to a working width of the machine.

[0036] As described above, the controller 2 includes an electronic output 8 configured to output control signals 9 generated by the processor 4 for controlling operation of the harvester 50. Specifically, processor 4 is operable to generate, and the controller 2 operable to then output via output 8, control signals 9 to a guidance system 35 of the harvester 50 for controlling motion of the harvester 50, e.g. through control over a steering system and/or a propulsion system of the harvester 50, for controlling motion of the harvester 50 along the determined operational path. As will be appreciated, the controller 2 may output the control signals 9 to a local processing unit, e.g. a control unit of the guidance system 35 for controlling operation thereof.

Output 10 is operably coupled to a user interface 32 associated with the harvester 50. As will be appreciated and is discussed herein, the user interface 32 may form part of a portable device, such as a phone or tablet computer, and/or may form part of a display screen within an operator cab of the harvester 50. Here, the control system 1 is operable to control operation of the user interface 32, e.g. through output of control signals 11 in order to display data to an operator of the harvester 50 relating to the operation of the control system 1. Specifically, the control system 1 is operable to control the user interface 32 to display to the operator an indicator of determined operational path, e.g. for the operator to use to then control motion of the harvester 50 along that path, or indeed to monitor automated operation thereof.

[0038] Fig.2 Illustrates a system 60 embodying aspects of the invention. The system 60 comprises a distributed system with control system 1 [discussed hereinabove) shown remote from but io communication with the user interface 32 and harvester 50. In this embodiment, the remote control system 1 may be housed on a remote server or cloud based system and operable to communicate with the user interface 32 and/or harvester 50 over a wireless communication network. In alternative arrangements, the control system 1 may form part of the processing system(s) of the harvester 50 itself. Further, as described herein, the user interface 32 may form part of a display system of the harvester 50. [0039] FIG. 3 illustrates a method 100 embodying multiple aspects of thr present invention, which will be described herein with reference to FIGs 4-9., also.

[0040] in an initial step 101, Inputs are provided relating to the boundary of the working environment and obstacle data indicative of the boundary of obstacle(s) within the environment l ₁ data relating to the working width of the harvester 50 l ₂ , here comprising the width of a header 52 operatively coupled to the harvester 50, and data relating to a driving direction for the harvester 50 in the field. This may be predetermined, or may be determined, e,g. by the control system 1 based on the shape of the environment, far example,

[0041] At step 102, data relating to the one or more characteristics of each obstacle within the environment is assessed to determine the number of obstacles to he analysed in determination of the operational path.

[0042] At step 104, the data for each of the obstacles is analysed to determine therefrom whether any of the obstacles are "'point" obstacles. That is, any obstacles which can effectively be treated as a point object in the environment, and may include trees, electricity poles and the lite. For those obstacles which satisfy this condition a further check is mad® to determine whether the point obstacles are close to the field boundary (step 106). Here, a check is made to see whether any point obstacles are within 0.5m of the field boundary, however the skilled person would appreciate that this threshold distance may be different in different scenarios, and relates primarily to the working width of th® machine operating in the environment. Where point obstacles are determined to lie proximate to the field boundary they are effectively merged with the existing boundary to form a new boundary for the working environment. This is illustrated figuratively in FIG. 9, where point obstacles Ob and Oc are identified as proximate to field boundary B. Here, a new field boundary B' is determined which Involves merging the old field boundary B with th® positions of obstacles Ob and Oc. As discussed herein, waylines W for an operational path for th® harvester 50 are then determined based on the new field boundary B` [0043] The method then progresses to step 110 where a further cheek is performed to consider how dose adjacent obstacles are to one another, irrespective of any classification of obstacle type, In the illustrated embodiment, this comprises checking the distance between each of the obstacles against a threshold distance equal to the working width of the harvester 50. As discussed above, this is dependent on the width of the header 52, For those which are less than or equal to the working width of the harvester 50, these obstacles are merged to form a single obstacle (for consideration by the control system 1). This is illustrated figuratively in FIG, 7, where obstacles Oa and Ob are Identified as proximate to one another, i.e. at a distance which is less than or equal to the working width of the harvester 50. Here, a new obstacle O is defined encompassing both obstacle Oa and obstacle (3b. Again, as discussed herein, waylines W for an operational path for the harvester 30 are then determined with knowledge of the newly defined obstacle O. In short, a global set of waylines W is determined for the environment as a whole, with a sot of obstacle specific waylines W _a determined for the newly defined obstacle. The global set of waylines W and the obstacle specific waylines W _o define the operational path for the harvester 50.

[0044] Turning back to FIG 3, the method progresses to step 112 where a further check is performed to consider how close the remaining obstacles are to the boundary of the working environment. In the Illustrated embodiment, this comprises checking the distance between each of the remaining obstacles against a threshold distance equal to the working width of the harvester 50. As discussed above, this is dependent on the width of the header 52. For those which are positioned at a distance which is less than or equal to the working width of the harvester 50, they are merged into the boundary. This is Illustrated figuratively in FIG 5, where an obstacle O is identified as proximate to field boundary 8. Here, a new field boundary B' is determined which involves merging the old field boundary B with the positions of obstacle O. As discussed herein, waylines W for an operational path for the harvester SO are then determined based on the new field boundary B` [0045] As a next step, a check is made for any obstacles which cross the boundary of the working environment (step 114), For those which crass the boundary of the working environment, they are merged into the boundary. This is illustrated figuratively in FIG 4, where an obstacle O is identified as crossing the field boundary 8. Here, a new field boundary B' is determined which involves merging the old held boundary B with the position of obstacle O. As discussed heroin, waylines W for an operational path for the harvester 50 are then determined based on the new field boundary B’,

[0046] At step 116 a list of all obstacles is obtained following the various merge processes. For instance, those which have been merged into the boundary are no longer considered as obstacles but rather now define the boundary. Obstacles which have been merged with one another are considered single obstacles, etc. At step 118 each of the remaining point obstacles are replaced (from the point of view of the control system 1) with circles of radius Im. Again, the skilled person will appreciate that this is simply shown as an example. This circle defines a region around the point obstacle(s) where the machine cannot traverse and prevents waylines being generated for the operational path which pass through or close to said point obstacles at risk of a collision.

[0047] At step 120 the width of the remaining obstacles is determined with respect to the driving direction of the harvester 50. This is compared with a predetermined threshold value. Where this width is greater than the predetermined threshold value, the obstacle is classified as an "island” obstacle and handled in the manner discussed hereinbelow (step 128, discussed below). For those which are less than or equal to the predetermined threshold value a further check is performed (step 122) relating to the obstacle's length to width ratio, and comparison of that ratio with a further threshold value for further classification of the obstacle. Here, the ratio threshold Is set at 1.5, and obstacles where the length-to-width ratio is less than 1.5 are classified as "marker" obstacles, and those which have a length to width greater than 1.5 are classified as "narrow" obstacles. Both marker and narrow obstacles are handled similarly to point obstacles as discussed herein, and below with reference to steps 136 and 138. [0048] This is illustrated figuratively in FIG 10, showing harvester 50 with header 52 operating within an environment Here, an obstacle Oa is identified as a narrow obstacle with a width, d, which is less than the threshold valise [as determined with respect to the width of the header 52). Here, it is possible to simply deviate the waylines W of the operational path (W _adj ) to pass the obstacle Oa without needing to generate obstacle specific waylines (see below). on the other hand, obstacle Ob has a width which is greeter than the threshold and hence is classified as an island obstacle. Here, additional waylines Wadj need to be generated about the obstacle (again, see below).

[0049] Turning back to FIG. 3, the classification of the obstacles is saved into an obstacle list at step 126.

[0050] Step 128 comprises generating headland “passes” for each of the obstacles classified as "island'” obstacles. In practice, this comprises generating obstacle specific headland paths around the island obstacles. This is shown figuratively in FIG. 8, where for each of obstacles Oa, Ob, Oc, obstacle specific headland paths W _oa , W _ob , W _oc are determined and provided as part of the operational path along with global waylines W for the working environment. Here, the obstacle specific headland paths comprise a pair of concentric paths about each obstacle comprised of an Inner path and an outer path, as will be appreciated.

[0051] As shown in FIG. 6 & 8 , it is passible that with obstacles which are proximate to one another, and/or where obstacles are proximate to the field boundary (but at a distance which Is greater than the working width of the machine) there may be overlap In the obstacle specific headland paths or Indeed between the obstacle headland paths and the headland path about the boundary of the working environment. Accordingly, in an extension of the method 100, the operational path associated with an obstacle specific headland path may be truncated at any location where that path crosses a further headland path as defined by the overall operational path for the harvester 50. This is shown figuratively in FIG. 6, where obstacle G is identified and an obstacle headland path Wo is defined thereabout. Here, this includes sn inner headland path Woi and an outer headland path Wo,o effectively defining concentric rings about the obstacle O. In this Instance the distance between the obstacle O and the boundary B is greater than the working width of the harvester 50, but less than twice the working width of the harvester 50 and as such the outer headland path Wo,o intercepts the headland path W associated with the boundary B. Tn reduce overlap, and hence increase efficiency of the subsequent operation by the harvester 50 following the determined operational path, the present invention redefines the headland path about the obstacle O by truncating the outer headland path Wo,o between the points at which is intersects the boundary headland path W.

[0052] At step 130, a base model for the operational path is determined consisting of the generation of waylines for the environment as a whole. As described herein, this may be determined primarily on the overall shape and site of the environment, and may be predetermined from a desired driving direction through the environment. The base model is then adjusted to account for the characteristics of the Identified obstacles and the additional headland paths, boundary adjustments etc. discussed above.

[0053] For Instance, at step 132, a check is made to consider whether the generated wayiines for the environment are intercepted by any "island" obstacles (and the obstacle specific headland paths associated with those obstacles, determined in the manner discussed hereinabove). If so, each intercepted wayline is divided [step 134) Into a pre- obstacle portion and a past obstacle portion to remove any overlap.

[0054] At step 136, a check is made to consider whether the generated waylines for the environment are intercepted by any "narrow" or "marker" obstacles, determined in the manner discussed hereinabove. If so, each intercepted wayline is deviated to an extent such that the harvester 50 may bypass the obstacle(s) [step 138) but without needing to divide the wayline entirely - see FIG 10.

[0055] At step 140, the wayiines [and any adjustments made thereto) are saved in a location accessible by the control system 1. The saved wayiines define an overall operational path for the harvester 50 through the environment as determined with reference to both the boundary of the environment and one or more characteristics of obstacles within the environment. [0056] The method may then extend to generating and outputting control signals for controlling operation of one or more operational components associated with the harvester 50. As discussed herein, this can include controlling operation of a user interface 32 for displaying to an operator the determined operational path. This may be used by the operator to manually control the movement of the harvester 50 along the determined path, or may be used in a supervisory role monitoring operation of the harvester 50, e.g. where the harvester is being operated by another person and/or automated to some extent. In some variants, the method extends to at least partially automating motion of the harvester 50 along the determined operational path. As discussed herein, this may involve controlling a guidance system for the harvester, a steering system of the harvester and/or a propulsion system of the harvester, as will be appreciated.

[0057] All references cited herein are Incorporated herein in their entireties. If there is a conflict between definitions herein and in an incorporated reference, the definition herein shall control.