Technical Field

[0001] The present invention generally relates to loading bulk material into storage.

Background of Invention

[0002] Bulk materials, such as ores, coal, sands or grains, are typically collected (e.g., mined or harvested) at the sources, stockpiled, then transported and delivered to end users. The flow of materials between the origin and destination, can affect the profitability of such materials.

[0003] Transportation of bulk material is commonly facilitated by the use of a transportation vessel known as a bulk carrier. Such bulk carriers typically contain openings known as hatches, whereby the bulk material may be loaded into a storage area or hold of the bulk carrier for transport. Bulk carriers range in size from singlehold small carriers to very complex large ore ships having gear including cranes integral to the vessel, lights for twenty-four-hour-operation, bridges containing the equipment necessary to safely navigate a vessel on passage (such equipment will vary with ship type, but generally includes navigation devices, radars, communications systems and light/sound signalling devices).

[0004] Often bulk materials are continuously loaded into the hatches of a bulk carrier with a shiploader. These machines are located in ports to facilitate bulk material exportation. A shiploader mainly consists of a central column, a potentially extendable boom, a belt conveyor extending out of the boom structure, potentially a slewing mechanism, and a loading chute to transfer bulk materials from a source conveyor or feeder. The boom can move front and back, up and down by separate drives or actuators so that it can fill the whole breadth of the ship hold and adapt to the ships increasing draft while it is loaded.

[0005] Shiploaders are essential to the global shipping industry. Globalization has promoted the need for maritime ports to be equipped with efficient and durable shiploading machinery able to a handle a variety of bulk materials that enter into harbors within short time frames. This need for efficiency of loading and unloading has promoted advances in shiploader technologies including automation.

[0006] Automation of shiploaders can be difficult for a number of reasons. Loading a bulk carrier is time-consuming and dangerous. For example, if a loading error is made, it may cause a bulk carrier to capsize or strain the hull such that it breaks in half at the pier or wharf. Accordingly, it is crucial to distribute the bulk material correctly during loading in order to maintain stability of the vessel. Distributing bulk material in concert with a moving vessel can be difficult, particularly compensating for movement from swell, wind and tidal conditions that may vary from port to port.

[0007] Further, colliding with obstacles such as masts, communication assemblies, personnel and lighting structures may also have serious safety and throughput implications. While conveyor belts offer a very efficient method of loading, if they need to be shutdown due to a collision, for example, the required shutdown, repair and start-up and shutdown procedures can be complicated and require time to carry out.

[0008] Further, the conveyance of bulk materials may also generate dust and other airborne occlusions. Conventional sensors used in automation may be impacted if dust is present.

[0009] It would be desirable to provide a system for loading bulk material into a hold which ameliorates or at least alleviates one or more of the above problems or to provide an alternative.

[0010] It would also be desirable to provide a system for loading bulk material into a hold that ameliorates or overcomes one or more disadvantages or inconvenience of known shiploaders.

[0011] A reference herein to a patent document or other matter which is given as prior art is not to be taken as an admission or a suggestion that the document or matter was known or that the information it contains was part of the common general knowledge as at the priority date of any of the claims. Summary of Invention

[0012] According to an aspect of the present invention, there is provided a system for loading bulk material into at least one storage space, the system comprising: at least one conveyor mounted on a boom and cooperatively coupled for conveyance of bulk material from an infeed end of the conveyor to an output end of the conveyor; at least one arm supported by the boom and positioned proximate to the output end of the conveyor, the arm extending from the conveyor and bulk material thereon; at least one LiDAR sensor provided on the arm for detecting LiDAR sensor data from a region of at least one of the storage space and bulk material; and a processor configured to output data to position the boom relative to the storage space based on the LiDAR sensor data so as to optimise distribution of bulk material therein.

[0013] In one or more embodiments, the arm is supported vertically by the boom and extends away from the conveyor and bulk material thereon. Advantageously, this configuration positions the LiDAR sensors away from dust and other airborne occlusions that may be generated as bulk material is discharged into holds. LiDAR sensors can be sensitive to dust, rain, spray, sunlight and reflections and minimising filtering algorithms or the like to remove dust or spray noise from the sensor data by way of optimal mechanical positioning provides significant performance advantages. The sensors may also be positioned away from heavy wash-down as is required in shiploading systems from time-to-time.

[0014] In one or more embodiments, the storage space comprises a cargo hold accessible by a hatch opening in a ship. The ship may include a bulk carrier with a plurality of cargo holds accessible by respective hatches. Bulk carriers are a type of ship which transports cargo in bulk quantities. The cargo transported in such ships may be iron ore or coal.

[0015] In one or more embodiments, the LiDAR sensor data includes a plurality of LiDAR points, each LiDAR point having an associated location.

[0016] In one or more embodiments, the LiDAR sensor data includes data from a plurality of scans of the at least one LiDAR sensor. LiDAR point cloud data can include data obtained during a plurality of sensor scans. Each sensor scan can represent a full revolution of the LiDAR sensor. The LiDAR sensors may include internal prisms to create non-overlapping scan patterns.

[0017] In one or more embodiments, the processor is further configured to: generate, from the LiDAR sensor data, a representation of a LiDAR range image of the region of at least one of the storage space and bulk material; generate, using one or more machine-learned models, classification data from the representation of the LiDAR range image, the classification data representing one or more classifications of objects depicted in the LiDAR range image; determine one or more bounding shapes of the objects based at least on the classification data; and output data representing the one or more bounding shapes to position the boom relative to the respective object.

[0018] Advantageously, this configuration allows the system to leverage machinelearning technology or advanced algorithms to analyse the voxel grid representation and extract object information from the voxel grid representation of the LIDAR point cloud data. In some examples, object classification can include low-level information about the point cloud data, including information about how the bulk material is being stored in the hold (i.e., the storage space), including edges, surfaces, heights, volumes, widths, and so on. However, the system can, using one or more machine- learned models, identify one or more higher-level object classification based on the voxel grid representation. The detected objects may be a ship bridge, hatch covers in open and closed configurations, light poles, personnel, cranes, light and communications towers, cables and wires, tugboats, a bulk carrier, adverse environmental conditions. The detected objects may be represented in a bird's eye view.

[0019] In one or more embodiments, the processor is further configured to generate a voxel grid representation of the LiDAR sensor data.

[0020] In one or more embodiments, the one or more classification objects includes a ship. Preferably, the ship is a bulk carrier.

[0021] In one or more embodiments, the one or more classification objects include a hatch opening in a ship. [0022] In one or more embodiments, the one or more classification objects include at least one of an obstacle area or a restraint area. A restraint area may be a complicated area for the boom to navigate, such as a passage area, or close to an obstacle or personnel.

[0023] In one or more embodiments, the one of more classification objects includes a property of the bulk material. The property of the bulk material includes at least one of a height dimension, a height map, a width dimension, a volume, and a location of the bulk material within the storage space.

[0024] In one or more embodiments, the processor is further configured to dynamically compensate for movement or drift of the storage space. An advantage of this feature is that the boom can dynamically compensate for smaller movements of the ship to and/or away from the wharf and along the wharf caused by swell or tidal movement in substantially real-time. Not compensating for those minor movements may “blur” the sensor data, which may adversely affect the performance of system.

[0025] In one or more embodiments, the system includes a GPS (Global Positioning System) to determine a current location of the storage space. The GPS may include a real time kinematic (RTK) differential GPS receiver that can be used to obtain the position locations of LiDAR sensors with a very high degree of accuracy. Advantageously, the GPS may be used for time synchronization of each of the LiDAR sensor allowing the sensor data to be accurately combined into and single 3D image. The GPS may also provide positional information which in conjunction with existing shiploader position encoders can provide increased confidence and reliability of the boom position with respect to obstacles and the like.

[0026] In one or more embodiments, the system further comprises a plurality of LiDAR sensors spaced apart and positioned to provide a wide substantially uninterrupted view of the region of at least one of the storage space and bulk material.

[0027] In one or more embodiments, the processor is further configured to generate a fused representation of the region of at least one of the storage space and bulk material, based on the LiDAR sensor data detected from the plurality of LiDAR sensors, the LiDAR sensor data may be additionally or alternatively fused with other sensor data. Advantageously, fusing sensor data can improve the confidence of results, be it in depth finding from an image or for object detection applications when combined with GPS data, for example.

[0028] In one or more embodiments, the system includes at least two arms supported by the boom and positioned proximate to the output end of the conveyor, each arm extending away from each other, the conveyor and bulk material thereon.

[0029] In one or more embodiments, the at least two arms each support at least one LiDAR sensor.

[0030] In one or more embodiments, the at least two LiDAR sensors are arranged symmetrically with respect to a central axis.

[0031] In one or more embodiments, the system further comprises: an elevated bridge frame extending over the boom; and at least one LiDAR sensor provided on the elevated bridge for detecting LiDAR sensor data from the region of at least one of the storage space and bulk material. Advantageously, this arrangement is suitable for shuttle shiploaders.

[0032] In one or more embodiments, the systems further comprises: an elevated mast frame supporting the boom as balanced structure; and; at least one LiDAR sensor provided on either side of the mast frame for detecting LiDAR sensor data from the region of at least one of the storage space and bulk material. Advantageously, this arrangement is suitable for slewing shiploaders.

[0033] According to an aspect of the present invention, there is provided a method for loading bulk material into at least one storage space, the method comprising: providing at least one conveyor mounted on a boom and cooperatively coupled for conveyance of bulk material from an infeed end of the conveyor to an output end of the conveyor; providing at least one arm supported by the boom and positioned proximate to the output end of the conveyor, the arm extending from the conveyor and bulk material thereon; providing at least one LiDAR sensor provided on the arm for detecting LiDAR sensor data from a region of at least one of the storage space and bulk material; and accessing a processor configured to output data to position the boom relative to the storage space based on the LiDAR sensor data so as to optimise distribution of bulk material therein.

[0034] According to an aspect of the present invention, there is provided an autonomous shiploader, comprising: at least one conveyor mounted on a boom and cooperatively coupled for conveyance of bulk material from an infeed end of the conveyor to an output end of the conveyor; at least one arm supported by the boom and positioned proximate to the output end of the conveyor, the arm extending from the conveyor and bulk material thereon; at least one LiDAR sensor provided on the arm for detecting LiDAR sensor data from a region of at least one of the storage space and bulk material; one or more processors; and one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising: outputting data to position the boom relative to the storage space based on the LiDAR sensor data so as to optimise distribution of bulk material therein.

Brief Description of Drawings

[0035] The invention will now be described in further detail by reference to the accompanying drawings. It is to be understood that the particularity of the drawings does not supersede the generality of the preceding description of the invention.

[0036] FIG. 1 shows a diagram of a system for loading bulk material into a storage space in accordance with an embodiment of the present invention;

[0037] FIG. 2 shows a rendering of two davit arms used to support a LiDAR sensor proximate to the output end of a conveyor in accordance with an embodiment of the present invention;

[0038] FIG. 3a shows a rendering of a LiDAR sensor configuration on a slewing shiploader in accordance with an embodiment of the present invention;

[0039] FIG. 3b shows a rendering of a LiDAR sensor configuration on a slewing shiploader in accordance with an embodiment of the present invention; [0040] FIG. 4 shows a rendering of a LiDAR sensor configuration on a shuttling shiploader in accordance with an embodiment of the present invention; and

[0041] FIG. 5 shows a block diagram of an example system for position a boom relative to a bulk carrier based on LiDAR sensor data so as to optimise distribution of bulk material therein.

Detailed Description

[0042] The invention is suitable for loading bulk material into a storage space or cargo hold of a bulk carrier by way of a shiploader, and it will be convenient to describe the invention in relation to that exemplary, but non-limiting, application. However, it will be appreciated that the same approach is applicable to other storage areas, stockpiles and the like. The approach is also suitable for other conveyance systems.

[0043] Examples of known shiploader installation configurations include several basic types of shiploading systems. These systems include fixed loaders, traveling loaders, quadrant loaders, slewing/traversing loaders, and linear loaders.

[0044] Referring firstly FIG. 1 , there is shown a simplified plan view of an exemplary embodiment of a system 100 for loading bulk material 102 into a storage space or cargo hold 104 of a bulk carrier 106 in accordance with an embodiment of the present invention. The bulk carrier 106 is docked adjacent to a berth, wharf or pier 108 in a body of water 110. In one or more embodiments, the body of water 110 is a seaport located on the shore of a sea or ocean. However, it will be appreciated that the invention may be suitable for use at different types of facilities handling bulk materials, for example, at a river port used for river traffic, such as barges and other shallow-draft vessels.

[0045] The bulk carrier 106 is typical of the type of transport vessel used for dry bulk material such as ores or coal and includes a bow 112, a stern 114, a first hold 116, a second hold 118, and a third hold 120 located between the bow 112 and the stern 114, but the number of holds of the bulk carrier is not limited thereto, and in this embodiment only five holds are taken as an example, but the number of holds may also be three, four or six, and is not limited herein. Towards the stern 114, there is a bridge 122, the bridge 122 contains the equipment necessary to safely navigate the bulk carrier 106 on passage. As described above, such equipment will vary with vessel type, but generally includes sensitive navigation devices, one or more radars, a communications system (including distress calling equipment and various antennas) and light/sound signalling devices. It will be appreciated that interference with the equipment on the bulk carrier 106, including the bridge 122, can present serious problems in regard to safety of the vessel and its personnel.

[0046] Each hold 116, 118, 120 is accessible by way of hatches 124. The hatches 124 provide an opening at the top of a cargo hold. Hatches 124 vary between bulk carriers but are generally rectangular and occupy a significant portion of the vessel’s breadth or beam. The bulk material 102 is stored holds 116, 118, 120 for transit. As bulk material 106 is distributed in each hold 116, 118, 120 the bulk carrier’s 106 position within the body of water 110 may change. In the simplest sense, as the volume of bulk material 102 increases in each hold 116, 118, 120 the vessel may increase its draft. However, depending on the distribution of the bulk material 102, the vessel may also list or pitch during operation, which can also pose a danger to the vessel and its personnel. Accordingly, the vessel may need to be loaded in a specific sequence so as to not overstress the hull.

[0047] According to an embodiment of the present invention, the bulk material 106 is conveyed to each hold 116, 118, 120 by at least one conveyor 128 mounted on a boom 126. The boom 126 and conveyor 128 receive the bulk material 106 along respective loading axes 132 and discharge the bulk materials to holds 116, 118, 120. As will be explained in greater detail below, the boom 126 is operable to vary its discharge points relative to its loading axes 132. In some embodiments, this is both radially and angularly and those skilled in the art will recognize suitable designs for providing the stated functions. For example, the invention is suitable for both linear and radial type shiploaders that pivot about a central point, the former having a longitudinal runway beam adjacent to the berth and the latter having a quadrant beam on a radius.

[0048] According to an embodiment of the present invention, the boom 126 includes two arms 132 supported by the boom 126 and positioned proximate to the output end 134 of the conveyor 128, the arms 132 extend away from the conveyor and bulk material thereon. Each arm 132 includes a Light Detection and Ranging (LiDAR) sensor 134 provided on the arm for detecting LiDAR sensor data from a region of at least one of the bulk carrier 106 (and holds 116, 118, 120 is accessible by way of a hatches 124 and bulk material 102). The LiDAR sensors 132, which may be commercially available off the shelf (COTS) components or the like, are arranged symmetrically with respect to a central axis of the conveyor 128. A direct benefit of this feature is that the LiDAR sensors 132 are positioned away from dust generated as the bulk material is discharged into holds 116, 118, 120. As will be appreciated by those skilled in the art, LiDAR sensors when used in this manner, may be subject to a range of austere environmental and atmospheric conditions (e.g., rain, spray, sunlight, dust, reflections) and minimising the need for filtering algorithms or the like to remove dust or spray noise from the sensor data by way of mechanical positioning provides a significant technical advantage.

[0049] The LiDAR sensors 134, 136 are in electrical communication with a processor 130 configured to output data to position the boom 126 relative to the cargo holds 116, 118, 120 and the bulk carrier 106 based on the LiDAR sensor data so as to optimise distribution of bulk material 102 therein. It will be appreciated by those skilled in the art that the processor 130 may use standard and proprietary communication protocols to transport the output data to position the boom 126 relative to cargo holds 116, 118, 120. These protocols may use telemetry techniques such as provided by wires, cables, fibre optics, and/or radiofrequency transmissions such as broadcast, microwave, and/or satellite communications.

[0050] The processor 130 in this example may perform local control of actuators and monitor sensors of the boom 126. For example, the boom 126 and other parts of the shiploader a may include one or more PLCs. A PLC is a small industrial computer originally designed to perform the logic functions formerly executed by electrical hardware (such as switches, and/or timers and counters). PLCs have evolved into controllers capable of controlling complex processes, and are used extensively in distributed control systems. Other controllers used in the filed may include process controllers and Remote Terminal Units, which may provide the same level of control as a PLC but may be designed for specific control applications. However, PLCs are often used as field devices because they are often more flexible, and configurable than special-purpose controllers. [0051] The PLC may control actuators and monitor sensors. Examples of actuators include rotary and linear motors, pneumatic actuators, hydraulic pistons, valves and pumps, among others that drive the shiploader machine. Examples of sensors include position encoders, level sensors, pressure sensors, angle sensors, inertial measurement unit(s), and/or other sensors. Any of the actuators or sensors may be “smart” actuators or sensors or intelligent electronic devices. Intelligent electronic devices may include intelligence for acquiring data, communicating with other devices, and performing local processing and control. An intelligent electronic device could combine an analog input sensor, analog output, low-level control capabilities, a communication system, and/or program memory in one device. The use of intelligent electronic devices in SCADA systems and distributed control systems may allow for automatic control of the boom 126 based on the data output from processor 130 and those skilled in the art will recognise suitable designs for providing the stated functions. The processor 130 encompassing several subprocessors and PLCs will be discussed in greater detail with reference to FIG. 5.

[0052] Referring to FIG. 2, there is shown two davit arms 202 used to support a LiDAR sensor 204 proximate to the output end 206 of a conveyor 208 in accordance with an embodiment of the present invention. The davit arms 202 provide a convenient means of supporting respective LiDAR sensors 204 up and away from the conveyor 208 and bulk material 212 thereon. As shown, the davit 202 includes a jib extending to one side and the jib includes a connection point for connecting the LiDAR sensor 204 and any associated cabling (not shown). It will be appreciated that the davit 202 may be provided in a sleeve, collar or the like, to allow the LiDAR sensor to be positioned at a selected angle of rotation around a vertical axis as represented by ellipsoid 216. The davit 202 may also be provided with a latch or locking mechanism to lock the davit 202 at a selected angle of rotation around that axis.

[0053] The conveyor 208 is mounted on a boom 210 and cooperatively coupled for conveyance of bulk material 212 from an infeed end of the conveyor (arrow 214) to an output end of the conveyor 206.

[0054] Those skilled in the art will recognize that the davit arms 202 are exemplary only and other arm designs are conceivable within the spirit and scope of the present invention. For example, an arm extending up and away from boom 210 at an angle. The arms 202 may be connected to the boom 240 by weld or mechanical fastener, for example, or by other means known in the art.

[0055] In the embodiment shown, two LiDAR sensors 204 are employed, but the number of LiDAR sensors 204 is not limited thereto, and in this embodiment only two sensors are taken as an example, but the number of sensors may also be four or six, and is not limited herein. The LiDAR sensors are spaced apart and positioned to provide a wide substantially uninterrupted view of the bulk material 212 and bulk carrier 106 including hold 102 and hatches 124. In embodiments employing a plurality of LiDAR sensors 204, the sensor data may be fused to provide a representation of the bulk material 212 and bulk carrier 106. It will be appreciated that the LiDAR sensor data may be additionally or alternatively fused with other sensor data.

[0056] In one or more embodiments, the configuration of LiDAR sensors 204 can include a first set of LiDAR sensors that include a field of view that encompasses a region in front of the boom 210, and a second set of sensors having a field of view that encompasses the side regions extending laterally from each side of the boom 210. As described herein, the side regions can extend to substantially include the full length of the bulk carrier 106. Advantageously, for slewing shiploaders, this can provide anticollision measurement and protection for the left-hand side and right-hand side of the boom as well as providing hatch coaming mapping regardless of which way the boom is slewed (i.e., towards the bow or towards the stern of the ship). Different configurations may be required for different shiploaders as discussed with reference to FIG. 3 and FIG. 4.

[0057] Referring to FIG. 3a, there is shown a rendering of a LiDAR sensor configuration on a slewing shiploader 302 in accordance with an embodiment of the present invention. LiDAR sensors 304a, 304b are disposed on an elevated mast frame 306 supporting boom 308 as a balanced structure. Those skilled in the art will recognise this arrangement to be typical of a slewing shiploader. In this example, the LiDAR sensors 304a, 304b have a field of view that encompasses the side regions extending laterally from each side of the boom 308 in addition to two LiDAR sensors 305a, 305b that include a field of view that encompasses a region in front of the boom 308. LiDAR sensors 305a and 305b are similarly positioned to the first set of LiDAR sensors 204 as described with reference to FIG. 2. As described herein, the side regions can extend to substantially include the full length of the bulk carrier 106. Advantageously, this allows for the system to identify obstacles, including light poles, hatch covers, the vessel bridge, cables and wires. Given the very broad field of view provided by the placement of the LiDAR sensors 304, obstacles may be detected and avoided in a variety of areas to protect the boom (e.g., underside, topside and sides).

[0058] Referring to FIG. 3b, there is shown an additional rendering of a LiDAR sensor configuration on a slewing shiploader 302 in accordance with an embodiment of the present invention. In this example, the LiDAR sensors 304a, 304b have a field of view that encompasses the side regions extending laterally from each side of the boom 308 in addition to two LiDAR sensors 305a, 305b that include a field of view that encompasses a region in front of the boom 308.

[0059] Referring to FIG. 4, there is shown a rendering of a LiDAR sensor configuration on a shuttling shiploader 402 in accordance with an embodiment of the present invention. LiDAR sensors 404a, 404b are disposed on an elevated bridge frame 406 extending over boom 408. Those skilled in the art will recognise this arrangement to be typical of a shuttling shiploader. In this example, the LiDAR sensors 404a, 404b also have a field of view that encompasses the side regions extending laterally from each side of the boom 408. As described herein, the side regions can extend to substantially include the full length of the bulk carrier 408 (in some instances the effective range may be in the order of 300 to 1000 metres). Advantageously, this allows for the system to identify obstacles, including light poles, hatch covers, the vessel bridge, cables and wires when the shiploader transits alongside the vessel (in order to avoid vessel haulage, for example).

[0060] As described with reference to FIG. 2, 3a and 3b, there is also shown two LiDAR sensors 405a, 405b positioned proximate to the boom tip 408.

[0061] FIG. 5 shows a block diagram of an example system 500 for positioning a boom relative to a bulk carrier based on sensor data so as to optimise distribution of bulk material therein. As illustrated, FIG. 5 shows a system 500 that can include a shiploader 502 and a processor 504 associated with the shiploader 502. The processor 504 can be located onboard the shiploader (e.g., it can be included on and/or within the shiploader 502) or remote from the shiploader 502 (e.g., a server accessed via a network).

[0062] The shiploader 502 can be configured to operate in a plurality of operating modes. The shiploader 502 can be configured to operate in a fully autonomous operating mode in which the shiploader 502 is controllable without user input (e.g., can load bulk material into a cargo hold optimally and autonomously move with no input from a human operator present in the shiploader 502 and/or remote from the shiploader 502). The shiploader 502 can operate in a semi-autonomous operating mode in which the shiploader 502 can operate with some input from a human operator present in the shiploader 502. In some embodiments, the shiploader 502 can implement operating assistance technology (e.g., collision mitigation system or a restraint system etc.), for example, to help assist a human operator of the shiploader 502. The shiploader 502 can also operate in a combination of the above modes, for example, the shiploader 502 may operate for long periods of time fully autonomously, then allow input from a human operator to trim the hatch. Advantageously, an operator may be able to make fine adjustments to the loading pattern, to ensure the vessel is stable prior to completion.

[0063] The processor 504 can include one or more processors and/or modules located onboard or remote from the shiploader 502. The processors 504 can include various components for performing various operations and functions. For instance, the processors can include one or more computers and one or more tangible, non- transitory, computer readable media (e.g., memory devices, etc.). The one or more tangible, non-transitory, computer readable media can store instructions that when executed by the one or more processors cause the shiploader 502 (e.g., its computing system, one or more processors, etc.) to perform operations and functions, such as those described herein for controlling a shiploader, and in particular a boom relative to a bulk carrier, communicating with other computing systems, etc.

[0064] The shiploader 502 can include a network system 506 configured to allow the processor 504 to communicate with other computing devices. The network system 506 can include any suitable components for interfacing with one or more networks 508, including, for example, transmitters, receivers, and/or other suitable components that can help facilitate communication. [0065] The processor 504 can use the network system 506 to communicate with one or more computing devices that are remote from the shiploader 502 over one or more networks 508 (e.g., via one or more wireless signal connections). The networks 508 can exchange signals, data (e.g., data from a computing device), and/or other information and include any combination of various wired (e.g., twisted pair cable) and/or wireless communication mechanisms (e.g., cellular, wireless, satellite, microwave, and radio frequency) and/or any desired network topology. For example, the network 508 can include a local area network (e.g., intranet, TCP/IP), wide area network (e.g., Internet, TCP/IP), wireless LAN network, and/or any other suitable communication network for transmitting data to and/or from the shiploader 502 and/or among computing systems.

[0066] As shown in FIG. 5, the shiploader 502 can include one or more sensors. As described above, the shiploader 502 may be fitted with four LiDAR sensors 510 installed at optimal vision points around the shiploader 502, for example, proximal to the boom tip 512 or on the bridge or apex 514 of the shiploader (based on the type of shiploader i.e., bridge for shuttling shiploader and apex for skewing shiploaders). The sensors generally operate on a time-of-flight principle. They emit pulses of laser light in a scanning pattern and measure the time taken for the pulses to reflect off an object and return to the sensor to calculate the distance to an object. One or more of these sensors 510 can be configured to communicate with a global positioning system (GPS) 516. In one or more embodiments of the present invention, the GPS 516 is real time kinematic (RTK) differential GPS receiver that can be used to obtain the position locations of LiDAR sensors 510 with very high accuracy. Advantageously, the GPS 516 may be used for time synchronization of each of the LiDAR scanner data streams allowing them to be accurately combined into and single 3D image. The GPS 516 may also provide positional information which in conjunction with existing shiploader 502 position encoders can provide increased confidence and reliability of the boom position 512. A direct benefit of this arrangement is that the boom 512 can compensate for smaller movements of the ship to and/or away from the wharf and along the wharf caused by swell (or broken or loose mooring lines) in substantially real time. In one or more embodiments, the hatches are tracked during ship drifts and the vision system 518 maps a LiDAR point cloud. Not compensating for the boom position 512 can lead to errors such as loading outside the hatch, or loading with the wrong distribution of ore in the hatch.

[0067] One or more of these systems can be configured to communicate with one another via one or more communication channels. The communication channels can include one or more data buses (e.g., controller area network, and/or a combination of wired and/or wireless communication links. The sensors 510 can send and/or receive data, messages, signals, etc. amongst one another via the communication channels. For example, each LiDAR sensor 510 may transport sensor data to a machine vision system 518 for processing e.g., assembling sensor (i.e., scan) data in module 520, fusing sensor data amongst other possibilities.

[0068] As described above, the sensors 510 can be configured to acquire sensor data. This can include sensor data associated with the surrounding environment of the shiploader 502 and bulk material. The surrounding environment of the shiploader 502 can include/be represented in the field of view of the sensors 510. While the sensors as described herein are generally LiDAR sensors, they should not be limited to LiDAR systems and may also include one or more Radio Detection and Ranging (RADAR) systems, one or more cameras, one or more motion sensors, and/or other types of imaging capture devices and/or sensors. It will be appreciated that the sensor data can include image data (e.g., video data, 2D camera data etc.), LiDAR data (e.g., 3D point cloud data, including a plurality of LiDAR points, each LiDAR point having an associated location on the bulk carrier etc.), LiDAR data from a plurality of sweeps, and/or other types of data.

[0069] The shiploader 502 can also include other sensors configured to acquire data associated with the shiploader 502, sensor data may be processed by machine vision system 518. As will be appreciated by those skilled in the art, the various sensor data be fused to improve the confidence of results, be it in depth finding from an image or for object detection applications. For example, a camera image and LiDAR point cloud may be overlapped and unsampled to obtain depth values for each pixel in the image, or the like. Additionally, or alternatively the machine vison module 518 may access LiDAR point cloud data and GPS 516 data. The LiDAR point cloud data can include data obtained during a plurality of sensor sweeps. Each sensor sweep can represent a full revolution of the LiDAR sensor as the boom 514 moves in relation to the cargo hold, for example. Thus, each sweep represents a different time step between a point in the past and the most recent sweep (effectively the current time). The LiDAR point cloud data and GPS data can be organized and represented as voxel grid representations. For example, the area associated with the LiDAR point cloud data can be subdivided into a plurality of voxels (e.g., three-dimensional portions of the total area) and each voxel can be assigned a value representing the number of points that fall into that voxel and their average distance from the sensor. Software running on modules 522 and 524 may then evaluate potential collision objects detected and reports their location and distance to the machine PLC 526 via a TCP/IP communications link.

[0070] In one or more embodiments, the machine vision module 518 consists of two modules 522 and 524. Module 522 can be dedicated to ship model protection systems, whereas module 524 can be configured to a real-time protection system. Both modules 522 and 524 report boom collision object data to the shiploader machine control PLC 526.

[0071] The ship model protection system 524 uses a scan of the vessel that is taken/updated when the boom conveyor is not moving and therefore not able to generate any dust which can interfere with LiDAR sensors 510. The model is stored in memory and is compared with a 3D model of the ship loader structure along with the machine position information reported by the encoders and GPS 516. Potential collision objects are calculated for each zone and report to the machine PLC 526. Advantageously, this configuration provides resilience to dust.

[0072] The real-time protection system 522 uses live scan data from LiDAR sensors 510. The system provides protection using data that is constantly updated from all LiDAR sensors 510. New collision objects can be detected in real-time, but environmental factors i.e., dust, fog may affect the performance. Software filters are used to remove these false detections from the scan data, and those skilled in the art will recognise filters for providing the stated functions.

[0073] The system 500 for positioning a boom relative to a bulk carrier can leverage machine-learning technology to analyse the voxel grid representation. In one or more embodiments, the processor 504 is configured to generate, using one or more machine-learned models, classification data from the voxel grid representation, the classification data representing one or more classifications of objects depicted in that LiDAR voxel grid representation. Bounding shapes of the objects based on the classification can be determined and data representing the one or more bounding shapes can be used to position the boom relative to the respective objects by way of PLC 526. The classification objects can include a bulk carrier itself, hatch openings in the bulk carrier, obstacle areas and the like. However, the classification objects can also include properties of the bulk material itself, for example, at least one of a height dimension, a height map, a heat map, a width dimension, a volume, and a location of the bulk material within the storage space (material deposition in the storage space or hold, natural settling effects, and the like), a trajectory of the bulk material.

[0074] Advantageously, classifying properties of the bulk material allows for the bulk material to be optimally distributed in the hold. For example, the bulk material can be evenly distributed to avoid listing and to protect the structural integrity of the hull, keep the vessel upright, among others. Those skilled in the art will appreciate that even distribution can be gauged from a height map among other possibilities. For example, a height map may include an array of height values and compared with a reference plane relating to the cargo hold. In some embodiments, the height map may be represented as a textured polygonal mesh from depth, and position data generated by the LiDAR sensors 510 and GPS data 516. The height map may alternatively be described as a “profile” of the bulk material.

[0075] One or more algorithms may be employed to maintain vessel list and evenly distribute the bulk material within the hold to enable the maximum capacity to be realised. As an example, an algorithm may generate load points within the safe pour zone of the hatch based on the vessel list and the stage of the pour, and prioritise which one of these to target based on the height of the hold bulk material profile. The target load point can then be converted to a set of machine drive targets for the automated motion control of the boom and shuttle, its spout or spoon and so forth. In a number of embodiments, the automated hatch loading supports dual loading a vessel through the synchronisation of available pour zones to ensure the shiploaders work together to control the vessel list, while maintaining safe machine separation and evenly distributing the bulk material within their respective holds. [0076] For instance, the processor 504 and in particular the machine vision module 518, can extract object information from the voxel grid representation of the LIDAR point cloud data. In some examples, object classification can include low-level information about the point cloud data, including information about how the bulk material is being stored in the hold, including edges, surfaces, heights, volumes, widths, and so on. However, the system 500 can, using one or more machine-learned models, identify one or more higher-level object classification based on the voxel grid representation. The classified and/or detected objects can be a ship bridge, hatch covers in open and closed configurations, light poles, personnel, cranes, light and communications towers, cables and wires, tugboats, a bulk carrier, adverse environmental conditions. The detected objects can be represented in a bird's eye view.

[0077] In one or more embodiments, the machine vision module 518 tracks the position of the hatch corner coordinates either by the hatch covers or the coaming itself. The PLC 526 then manipulates the position of the boom so that its position is dynamically updated to move with the ship to maintain the desired bulk material deposition point in the hatch. In some instances, the machine vision module 518 dynamically adjusts the bulk material deposition point to the port and starboard based on the list feedback of the ship. Additionally or alternatively, the machine vision module 518 may also evenly distribute the bulk material to the forward and aft parts of the hatch to create an even distribution length ways.

[0078] In one or more embodiments, the profile of the bulk material is maintained via two methods: modelled and measured as described above. For example, the profile of the bulk material my be continuously updated by a modelling algorithm by tracking properties of the bulk material. The properties of the material may include location and volume of the bulk material deposition in the hold, natural settling effects, and the like. The volume of the bulk material is known from the discharge rates and material density, while the location of deposition is determined based on the intersection point of the latest hold bulk material profile and ore trajectory as determined by any one of the methods as described above. As will be appreciated by those skilled in the art, the intersection point relates to the point where the ore trajectory meets the bulk material in the hold. The processor 504 and in particular the machine vision module 518 may generate a hatch map of the latest known bulk material profile height measurements, which is used to update and verify the modelled hold bulk material profile. The modelled bulk material profile enables the system 500 to maintain an accurate representation of the bulk material profile in areas of the hold that the machine module 518 is unable to measure due to obstructions from structures or the bulk material stream. The hold bulk material profile may then be passed through a smoothing algorithm to mimic the settling of bulk material in the hold based on the materials angle of response. Those skilled in the art will recognise that the angle of response relates to the angle of descent or dip relative to the horizontal plane on which the bulk material can be piled without slumping. At this angle, the material on the slope face is on the verge of sliding. The morphology of the material affects the angle of repose.

[0079] As examples, the one or more machine-learned models can be or can otherwise include various machine-learned models such as, for example, neural networks, convolutional neural networks (e.g., dual-head convolutional neural networks, etc.), decision trees, ensemble models, support vector machines, Bayesian networks, or other types of models including linear models, and/or non-linear models. Example neural networks include multi-layer perceptron networks, feed-forward neural networks, recurrent neural networks, convolutional neural networks, or other forms of neural networks.

[0080] As discussed above, the various embodiments can be implemented in a wide variety of operating environments, which in some cases can include one or more user computers, computing devices, industrial computers or processing devices which can be used to operate any of a number of applications. User or client devices can include any of a number of general purpose industrial or personal computers, such as desktop or laptop computers running a standard operating system, as well as cellular, wireless, and handheld devices running mobile software and capable of supporting a number of networking and messaging protocols. Such a system also can include a number of workstations running any of a variety of commercially available operating systems and other known applications for purposes such as image processing, computer vison and database management.

[0081] Some embodiments may utilize at least one network that would be familiar to those skilled in the art for supporting communications using any of a variety of commercially-available protocols, such as TCP/IP, OSI, FTP, UPnP, NFS, and CIFS. The network can be, for example, a local area network, a wide-area network, a virtual private network, the Internet, an intranet, an extranet, a public switched telephone network, an infrared network, a wireless network, and any suitable combination thereof.

[0082] The environment can include a variety of data stores and other memory and storage media as discussed above. These can reside in a variety of locations, such as on a storage medium local to (and/or resident in) one or more of the computers or remote from any or all of the computers across the network. In a particular set of embodiments, the information can reside in a storage-area network (“SAN”) familiar to those skilled in the art. Similarly, any necessary files for performing the functions attributed to the computers, servers, or other network devices can be stored locally and/or remotely, as appropriate. Where a system includes computerized devices, each such device can include hardware elements that can be electrically coupled via a bus, the elements including, for example, at least one central processing unit (CPU), at least one input device (e.g., a mouse, keyboard, controller, touch screen, or keypad), and at least one output device (e.g., a display device, printer, or speaker). Such a system can also include one or more storage devices, such as disk drives, optical storage devices, and solid-state storage devices such as random access memory (“RAM”) or read-only memory (“ROM”), as well as removable media devices, memory cards, flash cards, etc.

[0083] Such devices also can include a computer-readable storage media reader, a communications device (e.g., a modem, a network card (wireless or wired), an infrared communication device, etc.), and working memory as described above. The computer-readable storage media reader can be connected with, or configured to receive, a computer-readable storage medium, representing remote, local, fixed, and/or removable storage devices as well as storage media for temporarily and/or more permanently containing, storing, transmitting, and retrieving computer-readable information. The system and various devices also typically will include a number of software applications, modules, services, or other elements located within at least one working memory device, including an operating system and application programs, such as a client application or Web browser. It should be appreciated that alternate embodiments can have numerous variations from that described above. For example, customized hardware might also be used and/or particular elements might be implemented in hardware, software (including portable software, such as applets), or both. Further, connection to other computing devices such as network input/output devices can be employed.

[0084] Storage media and computer readable media for containing code, or portions of code, can include any appropriate media known or used in the art, including storage media and communication media, such as but not limited to volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage and/or transmission of information such as computer readable instructions, data structures, program modules, or other data, including RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a system device.

[0085] Embodiments of the present disclosure can be provided as a computer program product including a non-transitory machine-readable storage medium having stored thereon instructions (in compressed or uncompressed form) that can be used to program a computer (or other electronic device) to perform processes or methods described herein. The machine-readable storage medium can include, but is not limited to, hard drives, floppy diskettes, optical disks, CD-ROMs, DVDs, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, flash memory, magnetic or optical cards, solid-state memory devices, or other types of media/machine-readable medium suitable for storing electronic instructions. Further, embodiments can also be provided as a computer program product including a transitory machine-readable signal (in compressed or uncompressed form). Examples of machine-readable signals, whether modulated using a carrier or not, include, but are not limited to, signals that a computer system or machine hosting or running a computer program can be configured to access, including signals downloaded through the Internet or other networks. For example, distribution of software can be via Internet download.

[0086] Where the terms "comprise", "comprises", "comprised" or "comprising" are used in this specification (including the claims) they are to be interpreted as specifying the presence of the stated features, integers, steps or components, but not precluding the presence of one or more other features, integers, steps or components, or group thereof.

[0087] While the invention has been described in conjunction with a limited number of embodiments, it will be appreciated by those skilled in the art that many alternative, modifications and variations in light of the foregoing description are possible. Accordingly, the present invention is intended to embrace all such alternative, modifications and variations as may fall within the spirit and scope of the invention as disclosed.