CROSS REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to and benefit of co-pending U.S. Provisional Patent Application No. 63/277,232 filed on November 9, 2021 entitled “PRECISE PAYLOAD DELIVERY RELATIVE TO PILED GRANULAR MATERIAL” by Benjamin H. Johnson et al., having Attorney Docket No. GWC-003-PR, and assigned to the assignee of the present application, the disclosure of which is hereby incorporated herein by reference in its entirety.

[0002] This application claims priority to and benefit of co-pending U.S. Provisional Patent Application No. 63/320,791 filed on March 17, 2022 entitled “MAPPING PILED GRANULAR MATERIAL IN A BULK STORE” by Benjamin H. Johnson et al., having Attorney Docket No. GWC-002-PR, and assigned to the assignee of the present application, the disclosure of which is hereby incorporated herein by reference in its entirety.

BACKGROUND

[0003] Some examples of granular material include, without limitation, include: grain (e.g., small hard seeds such as soybean seeds, pinto beans, corn kernels, wheat, and rice), non-grain plant seeds (e.g., flower seeds and grass seeds), nuts (e.g., shelled or unshelled tree nuts or ground nuts), sand, pelletized products (e.g., wood pellets, plastic pellets, etc.) and milled/ground products (e.g., flour, sugar, and mineral/rock aggregates, etc.). Granular material is often piled in a bulk store, either in the open or in a container such as a bin. Bulk stores, such as grain bins, are often hot, dirty, dusty, and dangerous workplaces. To adequately manage bulk stored granular materials farmers and/or other workers are required to enter bulk stores and/or climb about on the surface of a pile of the bulk stored granular material. Such interactions expose the farmer/worker to falls, entrapments, explosions, auger entanglements, heat stroke, and long-term conditions such as Farmer’s Lung. BRIEF DESCRIPTION OF DRAWINGS

[0004] The accompanying drawings, which are incorporated in and form a part of the Description of Embodiments, illustrate various embodiments of the subject matter and, together with the Description of Embodiments, serve to explain principles of the subject matter discussed below. Unless specifically noted, the drawings referred to in this Brief Description of Drawings should be understood as not being drawn to scale. Herein, like items are labeled with like item numbers.

[0005] Figure 1 shows an example block diagram of some aspects of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0006] Figure 2 shows block diagram of a collection of sensors, any or all of which may be incorporated the device of Figure 1, in accordance with various embodiments.

[0007] Figure 3 shows block diagram of a collection of payloads, any or all of which may be incorporated the device of Figure 1, in accordance with various embodiments.

[0008] Figures 4A-1, 4A-2, and 4A-3 illustrate front elevational views of the exterior of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0009] Figures 4B-1 and 4B-2 illustrate rear elevational views of the exterior of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0010] Figures 4C-1 and 4C-2 illustrate right elevational views of the exterior of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0011] Figures 4D-1 and 4D-2 illustrate left elevational views of the exterior of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0012] Figures 4E-1 and 4E-2 illustrate bottom plan views of the exterior of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0013] Figure 4F illustrates a top plan view of the exterior of a device which moves about and/or operates in relation to a pile of granular material along with a chart illustrating directional movements, in accordance with various embodiments. [0014] Figure 4G illustrates an upper front right perspective view of the exterior of a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0015] Figure 5 illustrates some example embodiments of a bulk store slope adjustment system, in accordance with various embodiments.

[0016] Figure 6 illustrates some example embodiments of a bulk store slope adjustment system, in accordance with various embodiments.

[0017] Figure 7A illustrates an example bulk store for granular material, in accordance with various embodiments.

[0018] Figure 7B illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0019] Figure 7C illustrates a top sectional view B-B of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0020] Figure 7D illustrates a top sectional view B-B of an example bulk store for granular material which shows pattern for moving a device about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments.

[0021] Figure 7E illustrates a top sectional view B-B of an example bulk store for granular material which shows pattern for moving a device about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments.

[0022] Figure 7F illustrates a top sectional view B-B of an example bulk store for granular material which shows pattern for moving a device about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments.

[0023] Figure 7G illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0024] Figure 7H illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0025] Figure 71 illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0026] Figure 7J illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0027] Figure 7K illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0028] Figure 7L illustrates a side sectional view A-A of an example bulk store for granular material which shows a device moving about and/or operating in relation to a portion of piled granular material in the bulk store, in accordance with various embodiments. [0029] Figures 8A-E illustrate a flow diagram of an example method of bulk store slope adjustment, in accordance with various embodiments.

[0030] Figures 9A-9C illustrate a plurality of patterns for surface mapping and/or surface management are illustrated, in accordance with some embodiments

[0031] Figures 10A-10F illustrate some example three-dimensional maps of the surfaces of a piled granular material assembled from three-dimensional locations of a robotic device recorded during traversal of the surface in a mapping pattern, according to various embodiments.

[0032] Figure 10G illustrates an example three-dimensional map of the surface and the inside of a piled granular material assembled from a plurality of three-dimensional surface maps, according to various embodiments.

[0033] Figures 11 A-l IE illustrate various views of an example probe delivery payload which may be coupled to and controlled by a device which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments. [0034] Figure 12 illustrates a right elevational view of the exterior of a device which moves about and/or operates in relation to a pile of granular material and which includes a probe delivery payload, in accordance with various embodiments.

[0035] Figure 13 illustrates robot delivery of a payload, which may be a probe or sensor, in a bulk store in a predetermined three-dimensional pattern as granular material such as grain is added to the bulk store, according to various embodiments. [0036] Figure 14 illustrates robot delivery of a payload, which may be a probe or sensor, in a bulk store when triggered by detection of specified criteria, according to various embodiments.

[0037] Figure 15 illustrates robot delivery of a payload, which may be a probe or sensor, in a bulk store when triggered by human engagement, according to various embodiments.

[0038] Figures 16A-16D illustrate a flow diagram of an example method of surface management of piled grain, in accordance with various embodiments.

[0039] Figures 17A-17E illustrate a flow diagram of an example method of mapping within a bulk store of granular material, in accordance with various embodiments.

DESCRIPTION OF EMBODIMENTS

[0040] Reference will now be made in detail to various embodiments of the subject matter, examples of which are illustrated in the accompanying drawings. While various embodiments are discussed herein, it will be understood that they are not intended to limit to these embodiments. On the contrary, the presented embodiments are intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope the various embodiments as defined by the appended claims. Furthermore, in this Description of Embodiments, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the present subject matter. However, embodiments may be practiced without these specific details. In other instances, well known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the described embodiments.

Overview of Discussion

[0041] A device which can operate via remote controlled instruction, autonomously, or some combination thereof is described. The device is robotic and may be referred to as a “robot” or as a “robotic device,” and includes an auger-based drive system which facilitates the movement and/or operation of the device in relation to a portion of piled granular material in a bulk store, such as a grain bin. More particularly, because of the augers in the augerbased drive system, the device can operate and maneuver upon or beneath piled granular material. Additionally, and advantageously, augers of the auger-based drive system move and disrupt piled granular material as a consequence of the movement of the device.

[0042] A bulk store is the place where granular material is piled for bulk storage. Although a grain bin is frequently used herein as an example of a bulk store, nearly any bulk store which is large enough for a human to access and work inside or upon the stored granular material is a candidate for operation of the device described herein. Accordingly, it should be appreciated that other large bulk stores are also suitable bulk stores for use of the described device in relation to piled granular material in many of the manners described herein. Some examples of other large bulk stores include, but not limited to: containers (e.g., railcars, semi-trailers, barges, ships, and the like) for transport/storage of granular material, buildings (e.g., silos) for storage of granular material, and open storage piles of granular material.

[0043] Bulk stored granular material can present many safety concerns for humans. For example, bulk stores are often hot, dusty, poorly lit, and generally inhospitable work environments for humans. Additionally, entrapments can take place when a farmer or worker is in a bin and bulk stored material, such as grain, slides onto or engulfs the person.

Entrapments can happen because a slope angle of the piled granular material (e.g., grain) is at a critical angle which may slide when disturbed by the person else when may slide when extraction augers disturb the bulk stored granular material. As one example, steep walls of grain can avalanche onto a farmer/worker trying to mitigate problems in a grain bin, inspect the stored grain, or agitate the grain to improve the outflow. Additionally, sometimes a bridge/crust layer can form over a void in a pile of grain and when a farmer/worker walks across it or tries to break it with force, the grain bridge can collapse and entrap the person. As this bridge/crust layer and/or the size of the void below it may be invisible to the human eye, it can present an unknown danger to a farmer/worker. As will be discussed, many of these and other safety concerns can be reduced or eliminated through use of the device and techniques/methods described herein.

[0044] Among other things, the device described herein can be used to address managing the quality of bulk stored granular material (e.g., grain in a bin) through tasks like, but not limited to: inspections of the bulk stored granular material, leveling of the bulk stored granular material, agitating of the bulk stored granular to prevent/reduce spoilage, dispersing of the bulk stored granular material while it is being loaded into the bulk store, feeding a sweep auger or other collection device which removes the bulk stored granular material from the bulk store, and/or lowering the slope angles of the granular material in a partially emptied bulk store. In short, the device can accomplish numerous tasks which when done by the device preclude the need for humans to enter a bulk store, or else make it safer when it is necessary for humans to enter a bulk store. In various embodiments, these tasks can be carried out by the device under remote-control of the device by an operator located outside the bulk store, may be carried out in a partially fashion by the device, and/or may be carried out by the device in fully automated fashion. In short, a human is not required to enter a bulk store or personally traverse the piled granular material. As a consequence, safety to humans is drastically improved with regard to tasks related to management of a bulk store. In an event where a human chooses to enter a bulk store, the device can manage/prepare the surface by removing crusts, grain bridges, and reducing slope so that the piled granular material is safer for human traversal.

[0045] Additionally, as an extension of the device traversing the surface of piled granular material, the device can note and record its locations at a plurality of points on the surface such that a mapping of the three-dimensional contours of the upper surface of the piled granular material in the bulk store can be constructed of the points of location of the device. The mapping can further include environmental characteristics measured at respective locations with on the surface. Several surface maps can be sequentially captured during the fill of a bulk store such that when compiled a three-dimensional map is assembled which illustrates environmental characteristics not only on the surface of the piled granular material, but also beneath the existing surface at the levels of previous surfaces where mapping was accomplished prior to the filling of additional granular material. Such mappings have many beneficial uses. For example, a surface contour map can be combined with information regarding test weights (i.e., moisture levels) of piled grain and the location of the floor of the bulk store to estimate an amount of granular material (e.g., grain) stored in the bulk store (i.e., a number of bushels or other weight or volume). In another example, a surface contour map can be utilized to determine whether and where surface leveling should be performed by the device. In another example, an environmental characteristics map can indicate one or more areas of concern which may need to be cooled, dispersed, or otherwise attended to by the robotic device described herein.

[0046] Although tracked and wheeled devices would seem to be alternatives to the auger-driven device described herein, both of drive systems have been found ill-suited to operation on piled granular material. For example, wheeled and tracked devices are both easily bogged down when operating on piled granular material, such that they exhibit poor mobility in traversing piled granular material. Additionally, wheeled and tracked devices do not provide the ability to agitate or disrupt piled granular material in a meaningful manner to assist with hot-spot mitigation, mixing, or dispersion of piled granular material. Likewise, wheeled and tracked devices do not provide the ability to or to incite sediment gravity flow in a meaningful manner to facilitate leveling of piled granular material. Further, wheeled and tracked device do not recover well or at all from being buried in piled granular material, as may happen during a filling operation of a bulk store or during a slide/collapse in a bulk store - whereas the auger-driven device described herein may become buried by granular material but will naturally auger its way back to a surface.

[0047] Discussion begins with a description of notation and nomenclature.

Discussion then shifts to description of some block diagrams of example components of some examples of a robotic auger-driven “device” which moves about and/or operates in relation to a bulk stored pile of granular material. A variety of sensors and payloads which may be included with and/or coupled with the device are described. Numerous example views of the exterior of a device are presented and described, to include description of the auger-based drive system of the device. Several systems for remote-controlled semi-autonomous, and autonomous operation of the device are described. Additionally, systems and techniques for storing information from the device and/or providing information and/or instructions to the device are described. An example bulk store for granular material is then depicted and described in conjunction with operation of the device in relation to piled granular material in the bulk store. Operation of the device and components thereof, to include some sensors of the device, are discussed in conjunction with a variety of methods/modes of operation. For example, operation of the device is discussed in conjunction with description of an example method of bulk store leveling. Additionally, operation of the device and system in which it is included are discussed in conjunction with example methods of mapping, by or with the device of piled granular material in a bulk store and/or in conjunction with positioning one or more probes onto the surface of the piled granular material.

Notation and Nomenclature

[0048] Some portions of the detailed descriptions which follow are presented in terms of procedures, logic blocks, processes, modules and other symbolic representations of operations on data bits within a computer memory. These descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. In the present application, a procedure, logic block, process, module, or the like, is conceived to be one or more self-consi stent procedures or instructions leading to a desired result. The procedures are those requiring physical manipulations of physical quantities. Usually, although not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated in an electronic device/component. [0049] It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussions, it is appreciated that throughout the description of embodiments, discussions utilizing terms such as “controlling,” “obtaining,” “satisfying,” “failing to satisfy,” “traversing,” “inciting,” “satisfying,” “ceasing traversal,” “continuing traversal,” “capturing,” “sensing,” “collecting,” “directing,” and “determining,” “communicating,” “receiving,” “receiving instructions,” “receiving data.” “sending,” “relaying,” “providing access,” “deliver,” “deposit,” “place,” “recording,” “assembling,” “capturing,” and “communicatively coupling,” or the like, refer to the actions and processes of an electronic device or component such as (and not limited to): a host processor, a sensor processing unit, a sensor processor, a digital signal processor or other processor, a memory, a sensor (e.g., a temperature sensor, motion sensor, etc.), a computer, a remote controller, a device which moves about and/or operates in relation to a portion of piled granular material, some combination thereof, or the like. The electronic device/component manipulates and transforms data represented as physical (electronic and/or magnetic) quantities within the registers and/or memories into other data similarly represented as physical quantities within memories and/or registers or other such information storage, transmission, processing, and/or display components.

[0050] Embodiments described herein may be discussed in the general context of processor-executable instructions residing on some form of non-transitory processor-readable medium, such as program modules or logic, executed by one or more computers, processors, or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or distributed as desired in various embodiments.

[0051] In the figures, a single block may be described as performing a function or functions; however, in actual practice, the function or functions performed by that block may be performed in a single component or across multiple components, and/or may be performed using hardware, using software, or using a combination of hardware and software. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure. Also, the example electronic device(s) described herein may include components other than those shown, including well-known components.

[0052] The techniques described herein may be implemented in hardware, or a combination of hardware with firmware and/or software, unless specifically described as being implemented in a specific manner. Any features described as modules or components may also be implemented together in an integrated logic device or separately as discrete but interoperable logic devices. If implemented in software, the techniques may be realized at least in part by a non-transitory computer/processor-readable storage medium comprising computer/processor-readable instructions that, when executed, cause a processor and/or other components of a computer, computer system, or electronic device to perform one or more of the methods and/or actions of a method described herein. The non-transitory computer/processor-readable storage medium may form part of a computer program product, which may include packaging materials.

[0053] The non-transitory processor-readable storage medium (also referred to as a non-transitory computer-readable storage medium) may comprise random access memory (RAM) such as synchronous dynamic random access memory (SDRAM), read only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, other known storage media, and the like. The techniques additionally, or alternatively, may be realized at least in part by a processor- readable communication medium that carries or communicates code in the form of instructions or data structures and that can be accessed, read, and/or executed by a computer or other processor.

[0054] The various illustrative logical blocks, modules, circuits and instructions described in connection with the embodiments disclosed herein may be executed by one or more processors, such as host processor(s) or core(s) thereof, digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), application specific instruction set processors (ASIPs), field programmable gate arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. The term “processor,” as used herein may refer to any of the foregoing structures or any other structure suitable for implementation of the techniques described herein. In addition, in some aspects, the functionality described herein may be provided within dedicated software modules or hardware modules configured as described herein. Also, the techniques could be fully implemented in one or more circuits or logic elements. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a plurality of microprocessors, one or more microprocessors in conjunction with an ASIC or DSP, or any other such configuration or suitable combination of processors.

Example Block Diagrams of a Device which Moves About and/or Operates in Relation to a Pile of Granular Material

[0055] Figure 1 shows an example block diagram of some aspects of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments. As previously discussed, device 100 may be referred to a robot and/or robotic device, and device 100 may carry out some or all of its functions and operations based on stored instructions.

[0056] As shown, example device 100 comprises a communications interface 101, a host processor 102, host memory 103, an interface 104, motor controllers 105, and drive motors 106. In some embodiments, device 100 may additionally include one or more of communications 107, a camera(s) 108, one or more sensors 120, and/or one or more payloads 140.

[0057] Communications interface 101 may be any suitable bus or interface which facilitates communications among/between components of device 100. Examples of communications interface 101 include a peripheral component interconnect express (PCIe) bus, a universal serial bus (USB), a universal asynchronous receiver/transmitter (UART) serial bus, a suitable advanced microcontroller bus architecture (AMBA) interface, an Inter- Integrated Circuit (I2C) bus, a serial digital input output (SDIO) bus, or other equivalent and may include a plurality of communications interfaces.

[0058] The host processor 102 may, for example, be configured to perform the various computations and operations involved with the general function of device 100 (e.g., sending commands to move, steer, avoid obstacles, and operate/control the operation of sensors and/or payloads). Host processor 102 can be one or more microprocessors, central processing units (CPUs), DSPs, general purpose microprocessors, ASICs, ASIPs, FPGAs or other processors which run software programs or applications, which may be stored in host memory 103, associated with the general functions and capabilities of device 100. [0059] Host memory 103 may comprise programs, modules, applications, or other data for use by host processor 102. In some embodiments, host memory 103 may also hold information that that is received from or provided to interface 104, motor controlled s) 105, communications 107, camera(s) 108, sensors 120, and/or payloads 140. Host memory 103 can be any suitable type of memory, including but not limited to electronic memory (e.g., read only memory (ROM), random access memory (RAM), or other electronic memory). [0060] Interface 104 is an external interface by which device 100 may receive input from an operator or instructions. Interface 104 is one or more of a wired or wireless transceiver which may provide connection to an external transmission source/recipient for receipt of instructions, data, or direction to device 100 or offload of data from device 100. One example of an external transmission source/external recipient may be a base station to which device 100 communicates collected data or from which device 100 receives instructions or direction. Another example of an external transmission source/recipient is a handholdable remote-controller to which device 100 communicates collected data or from which device 100 receives instructions or direction. By way of example, and not of limitation, in various embodiments, interface 104 may comprise one or more of: a cellular transceiver, a wireless local area network transceiver (e.g., a transceiver compliant with one or more Institute of Electrical and Electronics Engineers (IEEE) 802.11 specifications for wireless local area network communication (e.g., WiFi)), a wireless personal area network transceiver (e.g., a transceiver compliant with one or more IEEE 802.15 specifications (or the like) for wireless personal area network communication), and a wired a serial transceiver (e.g., a universal serial bus for wired communication).

[0061] Motor controlled s) 105 are mechanism(s), typically circuitry and/or logic, which operate under instruction from processor 102 to drive one or more drive motors 106 with electricity to govern/control the direction and/or speed of rotation of the drive motor(s) 106 and/or or other mechanism of movement to which the drive motor(s) 106 are coupled (such as augers). Motor controlled s) 105 may be integrated with or separate from drive motor(s) 106

[0062] Drive motor(s) 106 are electric motors which receive electrical input from motor controlled s) 105 and turn a shaft in a direction and/or speed responsive to the electrical input. In some embodiments, drive motors 106 may be coupled directly to a mechanical means of drive motivation and steering — such as one or more augers. In some embodiments, drive motors 106 may be coupled indirectly, such as via a gearing or a transmission, to a mechanical means of drive motivation and steering - such as one or more augers. [0063] Communications 107, when included, may comprise external interfaces in addition to those provided by interface 104. Communications 107 may facilitate wired and/or wireless communication with devices external to and in some instances remote (e.g., many feet or even many miles away) from device 100. Communications protocols may include those used by interface 104 as well as others. Some examples include, but are not limited to: WiFi, LoRaWAN (e.g., long range wireless area network communications on the license-free sub-gigahertz radio frequency bands), IEEE 802.15.4-2003 standard derived communications (e.g., xBee), IEEE 802.15.4 based or variant personal area network (e.g., Bluetooth, Bluetooth Low Energy, etc.), cellular, and connectionless wireless peer-to-peer communications (e.g., ESP-NOW). In various aspects, communications 107 may be used for data collection/transmission, reporting of autonomous interactions of device 100, and/or user interface and/or operator interface with device 100.

[0064] Camera(s) 108 may comprise, without limitation: any type of optical sensor or infrared image sensor for capturing still or moving images. Some examples of suitable cameras include charge-coupled device (CCD) sensor cameras, metal-oxide semiconductor (MOS) sensor cameras, and other digital electronic cameras. Captured images may be utilized by device 100 for purposes such as navigation and decision making, may be stored, and/or may be transmitted to devices external to device 100. In some embodiments, camera(s) 108 facilitate wayfinding for device 100 when operating autonomously or semi- autonomously. In some embodiments, camera(s) 108 facilitate a remote view for an operator when device 100 is manually driven by a human user via a remote controller or computer system communicatively coupled with device 100. In some embodiments, an infrared camera 108 is used to find hotspots of grain to mix or agitate with device 100 (to reduce the heat of the hotspot). In some embodiments, computer vision is used by device 100 to make autonomous decisions based on inputs to processor 102 from camera(s) 108.

[0065] Figure 2 shows block diagram of a collection of sensors 120, any or all of which may be incorporated device 100 of Figure 1, in accordance with various embodiments. Sensors 120 illustrate a non-limiting selection of sensors, which include: motion sensor(s) 220, GNSS (Global Navigation Satellite System) receiver 230, ultrasonic transducer 231, LIDAR (light detection and ranging/laser imaging, detection, and ranging) 232, temperature sensor 233, moisture sensor 234, optical sensor 235 (e.g., an optical camera), infrared sensor 236 (which may be a receiver such as an infrared camera or an emitter/receiver), electrostatic sensor 237, electrochemical sensor 238, and a barometric pressure sensor 239. It is appreciated that one or more sensors may be combined. For example, several sensors may be combined in a device such as the ICM-20789 microelectromechanical sensor (available from InvenSense, a TDK group company, of San Jose, CA) which provides 7-axis sensing (3-axis accelerometer, 3-axis gyroscope, and 1-axis barometric pressure (for measuring elevation changes to less than 8.5 cm accuracy)) along with an on-board digital motion processor. In other embodiments, separate sensors may be used; for example, a stand-alone pressure sensor 239 may measure elevation, via differential barometric pressure measurement, of as little as 5cm (e.g., InvenSense sensor ICP-10101, as one example) while a motion sensor 220 includes an accelerometer 222 for measuring movement and a gyroscope 221 for measuring direction of movement). Other sensors may be additionally or alternatively included in some embodiments, for example a carbon dioxide sensor may be included to measure off-gassed carbon dioxide from piled grain, and/or an air flow sensor may be included to measure air flow through and around piled grain (air flow is used for drying the pile of grain but must be controlled to prevent over drying or undesired rehydration). In some embodiments, one or more microphones (not depicted), may be included as sensors. For example, an array of microphones may be used with a beamforming technique to locate the directional source of a sound, such as falling granular material being poured, conveyed, streamed, or augured into a bulk store. Some embodiments may additionally, or alternatively, include other sensors not described.

[0066] In general, individual sensors 120 operate to detect motion, position, timing, and/or some aspect of environmental context (e.g., temperature, atmospheric humidity, moisture of a sample or probed portion of granular material, distance to an object, shape of an object, solidity of a material, light or acoustic reflectivity, ambient charge, atmospheric pressure, presence of certain chemical(s), noise/sound, etc.). For example, in an embodiment where the piled granular material is grain, many of sensors 120 are used to determine the state of the grain (e.g., temperature, moisture, electrostatic charge, etc.). In some embodiments, one or more sensors 120 are used for fall detection, orientation, and to aid in autonomous direction of movement of device 100. For example, by detecting temperature of grain, device 100 may determine hot spots which need to be mixed by traversal with device 100 or by other means. Similarly, by detecting moisture of grain, device 100 may determine moist spots which need to be mixed by traversal with device 100 or by other means. By detecting an electrostatic and/or electrochemical aspect of the atmosphere in a grain bin, a level of dust or other particulates and/or likelihood of an explosion may be detected in order to gauge safety for a human and/or safety for operating device 100. [0067] Some embodiments may, for example, comprise one or more motion sensors 220. For example, an embodiment with a gyroscope 221, an accelerometer 222, and a magnetometer 223 or other compass technology, which each provide a measurement along three axes that are orthogonal relative to each other, may be referred to as a 9-axis device. In another embodiment three-axis accelerometer 222 and a three-axis gyroscope 221 may be used to form a 6-axis device. Other embodiments may, for example, comprise an accelerometer 222, gyroscope 221, compass, and pressure sensor, and may be referred to as a 10-axis device. Other embodiments may not include all these motions sensors or may provide measurements along one or more axes. In some embodiments, motion sensors 220 may be utilized to determine the orientation of device 100, the angle of slope or inclination of a surface upon which device 100 operates, the velocity of device 100, and/or the acceleration of device 100. In various embodiments, measurements from motion sensors 220 may be utilized by host processor 102 to measure direction and distance of travel and may operate as an inertial navigation system (INS) suitable for controlling and/or monitoring maneuvering of device 100 in a bulk store (e.g., within a grain bin). In some embodiments, motion sensors 220 may be used for fall detection. In some embodiments, motions sensor(s) 220 may be used to detect vibrations in the granular material proximate to device 100.

[0068] Figure 3 shows block diagram of a collection of payloads 140, any or all of which may be incorporated device 100 of Figure 1, in accordance with various embodiments. Payloads 140 illustrate a non-limiting selection of payloads, which include: ultraviolet germicidal 341, sample gatherer 342, percussive, probe/sensor delivery 344, air dryer 345, drill 346, sprayer 347, lights 348, and/or ripper 349.

[0069] Ultraviolet germicidal payload 341, when included, emits ultraviolet light to kill germs by irradiating in the proximity of device 100. Sample gatherer payload 342, when included, provides one or more containers or bays for gathering one or more samples of granular material from a pile of granular material upon which device 100 operates. Percussive payload 343, when included, operates to vibrate, or percussively impact piled granular material touching or in the proximity of device 100. Probe/sensor delivery payload 344, when included, operates to insert one or more probes or sensors into piled granular material upon which device 100 operates and/or to position one or more probes onto piled granular material upon which device 100 operates. Air dryer payload 345, when included, provides a fan and/or heater for drying piled granular material proximate to device 100. Drill payload 346, when included, operates to bore into and/or sample piled granular material and/or break up crusts or aggregations of piled granular material proximate to device 100. Sprayer payload 347, when included, operates to spray fungicide, insecticide, or other liquid or powdered treatments onto piled granular material proximate device 100. Lights payload 348, when included, emit optical and/or infrared illumination in the proximity of device 100. Ripper payload 349, when included, comprises one or more blades, tines, or the like and is used to rip into, agitate, and/or break up crusts or chunks of aggregated granular material proximate device 100. It should be appreciated that various payloads may be delivered, where delivery includes leaving or expelling the payload or a portion thereof at a designated location. For example, delivery can include leaving/installing a probe or sensor. Delivery may also include spraying or spreading a substance such as, but not limited to: a coolant, a flame retardant, an insecticide, a fungicide, or other liquid, gas, or powder.

[0070] In various embodiments, one or some combination of payloads 140 may be included in a payload bay of device 100. In some embodiments, the payload bay is fixed in place. In some embodiments, the payload bay may be removably coupled to device 100 to facilitate swapping it for another payload bay to quickly reconfigure device 100 with various different payloads.

Example External Views of a Device which Moves About and/or Operates in Relation to a Pile of Granular Material

[0071] Figures 4A-1, 4A-2, and 4A-3 illustrate front elevational views of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0072] With reference to Figure 4A-1, device 100 includes a body 401, motors 106 (106-1 and 106-2), transmissions 402 (402-1 and 402-2), and augers 403 (403-1 and 403-2). In the illustrated embodiment of device 100, a pair of bilateral augers 403 is utilized. In some embodiments, a drive motor 106 may be coupled to an auger 403 (such as to the end of an auger 403) in a manner that eliminates the need of a transmission 402 between the drive motor 106 and the auger 403. In the depicted embodiments, the transmission is located near the middle of each auger 403, thus bifurcating each auger into two portions. In Figure 4A-1, the front portion 403-1 A of auger 403-1 is visible, as is the front portion 403-2A of auger 403-2. In typical operation, augers 343 sink at least partially into the piled granular material and thrust against it as they rotate. The direction and speed of rotation of the augers 403 determines the movement fore, aft, left, right, turning left, and/or turning right of device 100. In this manner, in various embodiments, device 100 can move atop a pile of granular material, can move beneath a pile of granular material (i.e., submerged in it), and can move to the surface after being submerged in a pile of granular material. [0073] In some embodiments, device 100 includes one or more payloads 140. For example, lights payloads 348 (348-1 and 348-2) are included to provide illumination. In some embodiments, device 100 may additionally or alternatively include a payload bay 440 which may be fixed to device 100 or removably couplable with device 100. The payload bay 440 may provide a housing for one or more of the payloads 140 discussed herein and/or for other payloads. As one example, payload bay 440 may include sample gatherer payload 342 (show in the closed, non-sample gathering position as 342A). In some embodiments, one or more cameras 108 are included and coupled with body 401. In some embodiments, one or more sensors 120 are included and coupled with body 401 in a manner which provides access to the external environment of device 100. For example, one or more of ultrasonic transducer 231, LIDAR 232, temperature sensor 233, moisture sensor 234, optical sensor 235, infrared sensor 236, electrostatic sensor 237, and electrochemical sensor 238 may be included in a manner which provides sensor access to the operating environment of device 100.

[0074] Referring now to Figure 4A-2, device 100 is illustrated with sample gatherer payload 342 in an open, sample gathering position 342B, to scoop up a sample of granular material as device 100 moves forward with sample gatherer payload open and submerged into the piled granular material upon which device 100 operates.

[0075] Referring now to Figure 4A-3, device 100 is illustrated without payload bay 440. This illustrates a configuration of device 100 in which payload bay 440 has been removed or else device 100 is not configured to support a payload bay 440.

[0076] Figures 4B-1 and 4B-2 illustrate rear elevational views of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0077] With reference to Figure 4B-1, the rear portion 403-1B of auger 403-1 is visible, as is the rear portion 403-2B of auger 403-2.

[0078] With reference to Figure 4B-2, device 100 is illustrated without payload bay 440. This illustrates a configuration of device 100 in which payload bay 440 has been removed or else device 100 is not configured to support a payload bay 440.

[0079] Figures 4C-1 and 4C-2 illustrate right elevational views of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0080] With reference to Figure 4C-1, the full span of auger 403-2 is visible, including front portion 403-2A and rear portion 403-2B, as is the drive motor 106-2 and transmission 402-2 which drive auger 403-2. This lateral side of the auger-based drive system of device 100 comprises drive motor 106-2, transmission 402-2, and auger 403-2. As has been discussed, other embodiments may directly drive the auger with the drive motor, thus eliminating the transmission from the auger-based drive system.

[0081] With reference to Figure 4C-2, device 100 is illustrated without payload bay 440. This illustrates a configuration of device 100 in which payload bay 440 has been removed or else device 100 is not configured to support a payload bay 440.

[0082] Figures 4D-1 and 4D-2 illustrate left elevational views of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0083] With reference to Figure 4D-1, the full span of auger 403-1 is visible, including front portion 403-1 A and rear portion 403-1B, as is the drive motor 106-1 and transmission 402-1 which drive auger 403-1. This lateral side of the auger-based drive system of device 100 comprises drive motor 106-1, transmission 402-1, and auger 403-1. As has been discussed, other embodiments may directly drive the auger with the drive motor, thus eliminating the transmission from the auger-based drive system.

[0084] With reference to Figure 4D-2, device 100 is illustrated without payload bay 440. This illustrates a configuration of device 100 in which payload bay 440 has been removed or else device 100 is not configured to support a payload bay 440.

[0085] Figures 4E-1 and 4E-2 illustrate bottom plan views of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[0086] With reference to Figure 4E-1 a bottom plan view of device 100 is shown with a payload bay 440 coupled with device 100. As can be seen in Figure 4E-1, drive auger 403- 1 and drive auger 403-2 are arranged in a bi-lateral fashion, and have flighting wound in opposite directions from each other. Thus, the bi-lateral driver augers 403-1 and 403-2 may be referred to as “opposing screw” drive augers. Propulsion is through direct interaction with the granular material in which device 100 operates and can be forward, reverse, sideways, and turning.

[0087] With reference to Figure 4E-2, device 100 is illustrated in bottom plan view without payload bay 440. This illustrates a configuration of device 100 in which payload bay 440 has been removed or else device 100 is not configured to support a payload bay 440.

[0088] Figure 4F illustrates a top plan view of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material along with a chart 475 illustrating directional movements, in accordance with various embodiments. Chart 475 shows some examples of rotations of augers 403-1 and 403-2 utilized to implement movement of device 100 in the directions indicated by the arrows in the chart. The rotations and movement directions in chart 475 are in relation to the view of device 100 shown in Figure 4F. Although not depicted, in some embodiments, device 100 may be operated to move laterally to one side or the other.

[0089] Figure 4G illustrates an upper front right perspective view of the exterior of a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

Example Systems

[0090] Figure 5 illustrates some example embodiments of a bulk store slope adjustment system 500, in accordance with various embodiments. System 500 includes at least device 100 when operating autonomously. In some embodiments, system 500 may include device 100 and a remotely located remote controller 501 which is communicatively coupled by wireline 510 or wirelessly 520 with device 100 (e.g., to interface 104) to send instructions or data and/or to receive information or data collected by device 100 (e.g., from operation of device 100 and/or from sensor(s) 120 and/or payload(s) 140). Remote controller 501 may be like a handholdable remote controller for a video game, or a remotely controlled model car or model airplane. In some embodiments, remote controller may have a display screen for visual display of textual information or still/video images received from device 100. In some embodiments, remote controller 501 is utilized by an operator to maneuver device 100 and/or to operate sensor(s) 120 and/or payload(s) 140. In some embodiments, system 500 may include device 100 and a remotely located computer system 506 which is communicatively coupled wirelessly 580 with device 100 to send instructions or data and/or to receive/access information or data collected by device 100 (e.g., from operation of device 100 and/or from sensor(s) 120 and/or payload(s) 140). In some embodiments, system 500 may include device 100 along with a communicatively coupled remote controller 501 and a communicatively coupled remotely located computer system 506. It should be appreciated that wireless communications 520 and 580 may be peer-to-peer, over a wide area network, or by other protocols.

[0091] Figure 6 illustrates some example embodiments of a bulk store slope adjustment system 600, in accordance with various embodiments. In some embodiments, system 600 includes device 100 in wireless communicative coupling 650 (e.g., via the Internet) with one or more of cloud-based 602 storage 603 processing 604. In some embodiments, cloud-based 602 storage 603 is used to store data collected by device 100. In some embodiments, cloud-based processing 604 is used to process data collected by device 100 and/or to assist in autonomous decision making based on collected day. In some embodiments, system 600 additionally includes a remotely located computer 605, communicatively coupled to cloud 602 (e.g., via the internet) either wirelessly 670 or by wireline 660. In this fashion, remotely located computer 605 may access data from device 100 which has been uploaded to storage 603 and/or may communicate with or access device 100 by relay through processing/computer system 605 or cloud 602. In some embodiments, system 600 may additionally include one or more components (remote controller 501 and/or remotely located computer system 506) which were described in Figure 5. In some embodiments, one or more of remote controller 501 and remote computer system 506 may be communicatively coupled (e.g., 630/640) with cloud 602 for transmission and/or receipt of information related to device 100.

Example Bulk Store and Example Operations to Adjust Slope of a Portion of Piled Granular Material

[0092] Figure 7A illustrates an example bulk store 700 for granular material, in accordance with various embodiments. For purposes of example, and not of limitation, bulk store 700 is depicted as a grain bin which is used to bulk store grain (e.g., corn, wheat, soybeans, or other grain). Bulk store 700 includes an access door 705 through which device 100 may be inserted into and/or removed from bulk store 700. Bulk store 700 also includes a top loading portal 701 through which bulk grain or other granular material may be filled into bulk store 700, by an auger or other filling system (not depicted), and then fall into bulk store 700 to form a pile of granular material (e.g., grain 710 shown in Figure 7B). Section lines depict a location and direction of Section A-A and Section B-B which will be illustrated in other figures.

[0093] Figure 7B illustrates a side sectional view A-A of an example bulk store 700 for granular material which shows a device 100 moving about and/or operating in relation to a portion (portion 720 as shown in Figure 7C) of piled granular material (e.g., grain 710) in the bulk store 700, in accordance with various embodiments. Because some of grain 710 has been removed from the bottom of bulk store 700, a cone shaped concavity on surface 711 A has been created with a slope of approximately 20 degrees down from the walls to the center of bulk store 700 in the portion of piled granular material where device 100 is operating. The slope of 20 degrees is used for example purposes only. The maximum angle of the downward slope from the sides to the middle (or from the middle to the sides) is dictated by the angle of repose, which differs for different granular materials and may differ for a particular granular material based on environmental physical characteristics (such as moisture) of the granular material. When a granular material is steeply sloped and near the angle of repose, it can be easily triggered to slide and cause entrapment of a person. When the slope of a granular material exceeds its angle of repose, it slides (like an avalanche). Additionally, when a surface 711 A of grain 710 becomes steeply sloped toward the center (as illustrated) during removal of grain 710 from bulk store 700, it means that much of the removed grain is coming out from the center of the bin, rather than a mixture of grain from all areas of the bin. Leveling, or reduction of slope, of an inwardly sloped pile, reduces risk of a slide from a steeply sloped surface 711 A and distributes grain from the high sloped edges to prevent/reduce spoilage of those portions of the grain.

[0094] Due to the friction of augers 403 against grain 710 and the agitation of augers 403 caused to grain 710 when device 100 traverses a portion of piled granular material (e.g., portion 720 of grain 710), viscosity of the piled granular material at or near surface 711 A is disrupted. The disruption of viscosity lowers the angle of repose and, because of the slope being caused to exceed the angle of repose, incites sediment gravity flow in the portion of piled granular material down the slope. Additionally, rotational movement of the augers also displaces grain 710 and can be used to auger the grain in a desired direction or expel it such that gravity carries it down slope. Either or both of these actions can be used to disperse grain 710 and/or to adjust (reduce) the slope of the surface 711 A of portion 720 and other similar portions.

[0095] Figure 7C illustrates a top sectional view B-B of an example bulk store 700 for granular material which shows a device 100 moving about and/or operating on surface 711 A in relation to a portion 720 of piled granular material 710 in the bulk store 700, in accordance with various embodiments.

[0096] Figure 7D illustrates a top sectional view B-B of an example bulk store 700 for granular material which shows pattern 730 for moving a device 100 about and/or operating on surface 711 A in relation to surface a portion 720 of piled granular material 710 in the bulk store 700, in accordance with various embodiments. In some embodiments, pattern 730 may be manually driven by a remotely located operator via remote controller 501 (for example). In some embodiments, pattern 730 may be autonomously driven by device 100. In some embodiments, pattern 730 may be initiated due to a first measurement of the angle of slope of the surface 711 A of grain 710 in portion 720 satisfying a first condition such as being beyond an acceptable threshold angle (e.g., 10 degrees of slope). Pattern 730 or other patterns of traversal of portion 720 may be repeatedly driven until a follow-on measurement of the angle of slope of grain 710 in portion 720 meets a second condition (e.g., falls below the threshold angle or falls below some other angle such as 7 degrees). In this manner a portion (e.g., portion 720) or all of the grain in bulk store 700 can have its slope adjusted downward, closer to level.

[0097] Figure 7E illustrates a top sectional view B-B of an example bulk store 700 for granular material which shows pattern 731 for moving a device 100 about and/or operating on surface 711 A in relation to a portion 720 of piled granular material 710 in the bulk store 700, in accordance with various embodiments. In some embodiments, pattern 731 may be manually driven by a remotely located operator via remote controller 501 (for example). In some embodiments, pattern 731 may be autonomously driven by device 100. In some embodiments, pattern 731 may be initiated due to a first measurement of the angle of slope of surface 711 A of grain 710 in portion 720 satisfying a first condition such as being beyond an acceptable threshold angle (e.g., 10 degrees of slope). Pattern 731 or other pattern(s) of traversal of portion 720 may be repeatedly driven until a follow-on measurement of the angle of slope of surface 711 A of grain 710 in portion 720 meets a second condition (e.g., falls below the threshold angle or falls below some other angle such as 7 degrees). In this manner a portion (e.g., portion 720) or all of the grain in bulk store 700 can have its surface slope adjusted downward, closer to level.

[0098] Figure 7F illustrates a top sectional view B-B of an example bulk store 700 for granular material which shows pattern 732 for moving a device 100 about and/or operating on surface 711 A in relation to a portion 720 of piled granular material 710 in the bulk store 700, in accordance with various embodiments. In some embodiments, pattern 732 may be manually driven by a remotely located operator via remote controller 501 (for example). In some embodiments, pattern 732 may be autonomously driven by device 100. In some embodiments, pattern 732 may be initiated due to a first measurement of the angle of slope of surface 711 A of grain 710 in portion 720 satisfying a first condition such as being beyond an acceptable threshold angle (e.g., 10 degrees of slope). Pattern 732 or other pattern(s) of traversal of portion 720 may be repeatedly driven until a follow-on measurement of the angle of slope of surface 711 A of grain 710 in portion 720 meets a second condition (e.g., falls below the threshold angle or falls below some other angle such as 7 degrees). In this manner a portion (e.g., portion 720) or all of the grain in bulk store 700 can have its surface slope adjusted downward, closer to level. In Figure 7F, pattern 732 is confined to portion 720. In such an embodiment, only this portion may be leveled by device 100, or else device 100 may work its way around bulk store 700 portion by portion by portion, leveling surface 711 A in each portion completely or incrementally before moving to the next portion.

[0099] Figures 7D-7F illustrate only three example patterns, many other patterns are possible and anticipated including, but not limited to: grid patterns, circular patterns, symmetric patterns, unsymmetrical patterns, spiral patterns, random/chaos motion (e.g., patternless), patterns/paths that are dynamically determined based on the slope and changes of the slope, and patterns which are cooperatively executed by two or more devices 100 working in communication with one another. Any of the patterns executed by device 100 may be stored in host memory 103 for automated execution by processor 102 controlling the movements of device 100 to traverse the pattern. Similarly, patternless or dynamic movement may be executed by processor 102 in an automated fashion by controlling the movements of device 100, such as to seek out portions with a slope which satisfies a first condition and traverse them until the slope satisfies the second condition.

[00100] In some embodiments, patterns or traversal operations may similarly be utilized to break up and distribute grain 710 to assist it in drying out, to prevent a crust from forming, to inspect grain, to push grain towards a sweep auger or other uptake, and/or to diminish spoilage.

[00101] In some embodiments, patterns or traversal operations may similarly be utilized to level peaks which form in grain or other piled granular material due to the method and/or location in which it is loaded into a bulk store. Such leveling better utilizes available storage space, reduces crusts or pipe formation, reduces hotspots, and/or more evenly distributes granular material of differing moisture contents.

[00102] Figure 7G illustrates a side sectional view A-A of an example bulk store 700 for granular material 710 which shows a device 100 moving about and/or operating in relation to one or more portions (e.g., portion 720 and the like) on the surface 71 IB of piled granular material 710 in the bulk store 700, in accordance with various embodiments. Figure 7G is similar to Figure 7B except that the slope of the upper surface 71 IB has been downwardly adjusted from 20 degrees of surface 711 A to approximately 13 degrees (as measured by device 100 or other means) by traversal of the surface by device 100 in the manner previously described to effect surface leveling and slope adjustment. In an embodiment where this 13 degree slope is below a predetermined threshold, leveling and slope adjustment operations may cease. In an embodiment where this 13 degree slope is above a predetermined threshold, leveling and slope adjustment operations may continue toward achieving a slope threshold which is closer to 0 degrees. [00103] Figure 7H illustrates a side sectional view A-A of an example bulk store 700 for granular material 710 which shows a device 100 moving about and/or operating in relation to a one or more portions (e.g., portion 720 and the like) on the surface 711C of piled granular material 710 in the bulk store 700, in accordance with various embodiments. Figure 7H is similar to Figure 7G except that the slope of the upper surface 711C has been further downwardly adjusted from 13 degrees of surface 71 IB to approximately 5 degrees (as measured by device 100 or other means) by traversal of the surface by device 100 in the manner previously described to effect surface leveling and slope adjustment. In an embodiment where this 5 degree slope is below a predetermined threshold, leveling and slope adjustment operations may cease. In an embodiment where this 5 degree slope is above a predetermined threshold, leveling operations may continue toward achieving a slope threshold which is closer to 0 degrees.

[00104] Figure 71 illustrates a side sectional view A-A of an example bulk store 700 for granular material 710 which shows a device 100 moving about and/or operating in relation to one or more portions (e.g., portion 720 and the like) on the surface 71 ID of piled granular material 710 in the bulk store 700, in accordance with various embodiments. Figure 71 differs from Figures 7B, 7G, and 7H, in that the slope of surface 71 ID of grain 710 is now peaked in the middle and low on the edges, sloping downward at about 17 degrees from the center due to filling of additional grain 710 atop surface 711C of Figure 7H via centrally located top loading portal 701 (see e.g., Figure 7A). In some embodiments, device 100 can operate in the same manner to level grain 710 during and/or after completion of the fill operation.

[00105] Figure 7J illustrates a side sectional view A-A of an example bulk store 700 for granular material 710 which shows a device 100 moving about and/or operating in relation to a one or more portions (e.g., portion 720 and the like) on the surface 71 IE of piled granular material 710 in the bulk store 700, in accordance with various embodiments. Figure 7J is similar to Figure 71 except that the slope of the upper surface 71 IE has been downwardly adjusted from 17 degrees of surface 71 ID to approximately 4 degrees (as measured by device 100 or other means) by traversal of the surface by device 100 in the previously manner for surface leveling and slope adjustment. In an embodiment where this 4 degree slope is below a predetermined threshold, leveling and slope adjustment operations may cease. In an embodiment where this 4 degree slope is above a predetermined threshold, leveling operations may continue toward achieving a slope threshold which is closer to 0 degrees. [00106] Figure 7K illustrates a side sectional view A-A of an example bulk store 700 for granular material 710 which shows a device 100 moving about and/or operating in relation to one or more portions (e.g., portion 720 and the like) on the surface 71 IF of piled granular material 710 in the bulk store 700, in accordance with various embodiments. Figure 7K illustrates an embodiment where additional grain 710 has been loaded atop the substantially leveled surface 71 IE of Figure 7J and is now peaked in the middle and low on the edges, sloping downward at about 16 degrees from the center due to filling of additional grain 710 atop surface 71 IE of Figure 7J via centrally located top loading portal 701 (see e.g., Figure 7A). In some embodiments, device 100 can operate in the same manner to level grain 710 during and/or after completion of the fill operation.

[00107] Figure 7L illustrates a side sectional view A-A of an example bulk store 700 for granular material 710 which shows a device 100 moving about and/or operating in relation to a one or more portions (e.g., portion 720 and the like) on the surface 711G of piled granular material 710 in the bulk store 700, in accordance with various embodiments. Figure 7L is similar to Figure 7K except that the slope of the upper surface 711G has been downwardly adjusted from about 16 degrees of surface 71 IF to approximately 3 degrees (as measured by device 100 or other means) by traversal of the surface by device 100 in the previously manner for surface leveling and slope adjustment. In an embodiment where this 3 degree slope is below a predetermined threshold, leveling and slope adjustment operations may cease. In an embodiment where this 4 degree slope is above a predetermined threshold, leveling operations may continue toward achieving a slope threshold which is closer to 0 degrees.

Example Method of Bulk Store Slope Adjustment

[00108] Procedures of the methods illustrated by flow diagram 800 of Figures 8A-8E will be described with reference to elements and/or components of one or more of Figures 1- 7L. It is appreciated that in some embodiments, the procedures may be performed in a different order than described in a flow diagram, that some of the described procedures may not be performed, and/or that one or more additional procedures to those described may be performed. Flow diagram 800 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g., host processor 102 or any processor of device 100 or a computer or system to which device 100 is communicatively coupled) under the control of computer-readable and computer-executable instructions that are stored on non- transitory computer-readable storage media (e.g., host memory 103, other internal memory of device 100, or memory of a computer or system to which device 100 is communicatively coupled). It is further appreciated that one or more procedures described in flow diagram 800 may be implemented in hardware, or a combination of hardware with firmware and/or software.

[00109] For purposes of example only, the device 100 of Figures 1-7L is a robotic device which utilizes augers (403) to move and maneuver with respect to piled granular material, such as, but not limited to grain. Robot 100 will be described as operating on or in relation to piled granular material in a bulk store, such as, but not limited to grain in a grain bin. In some embodiments, the robot 100 is free of mechanical coupling with a structure (e.g., the bulk store) in which the piled granular material is contained. For example, in some embodiments, there is no tether or safety harness coupling the robot 100 to the grain storage bin and it operates autonomously or under wireless remote control. In some embodiments, robot 100 performs the method of flow diagram 800 completely autonomously. In some embodiments, robot 100 performs the method of flow diagram 800 semi-autonomously such as by measuring a slope of grain, sending the slope to an external computer system which then determines a pattern for robot 100 to autonomously execute when traversing the piled grain. In some embodiments, robot 100 performs the method of flow diagram 800 semi- autonomously such as by receiving a remotely measured slope of grain, then autonomously determining a pattern for robot 100 to autonomously execute when traversing the piled grain. [00110] Figures 8A-8E illustrate a flow diagram 800 of an example method of bulk store slope adjustment, in accordance with various embodiments.

[00111] With reference to Figure 8 A, at procedure 810 of flow diagram 800, in various embodiments, a robot 100 which includes a processor 102, a memory 103, and an augerbased drive system (e.g., augers 403), obtains a first measurement of an angle of slope of a portion of piled granular material in a bulk store, wherein the robot 100 comprises an augerbased drive system. With reference to Figures 7A-7L, this can comprise a measure of the angle of slope of the surface 711 of portion 720 of grain 710 in bin 700. The angle can be measured and obtained autonomously by robot 100 or can be measured by a device external to robot 100 and then obtained by being communicated to or accessed by robot 100. In an embodiment, where the angle of slope of surface 711 is measured by robot 100, motion sensor(s) 220 may be used to measure the angle of robot 100 on a slope of portion 720 to approximate the angle of the slope. In some embodiment, procedure 810 may be skipped and an operator may simply direct robot 100 to begin traversal of a portion (e.g., portion 720) of piled granular material. [00112] With continued reference to Figure 8A, at procedure 820 of flow diagram 800, in various embodiments, in response to the first measurement satisfying a first condition, the robot 100 traverses the portion of piled granular material to incite sediment gravity flow in the portion of piled granular material by disruption of viscosity of the portion of piled granular material through agitation of the portion of piled granular material by auger rotation of the auger-based drive system. The traversal may be controlled by host processor 102 via control of the direction of rotation and/or the speed of rotation of augers 403 of robot 100. Robot 100 may traverse the portion (e.g., portion 720) of the surface 711 of piled granular material (e.g., piled grain 710) in a predetermined pattern, which may be a predetermined pattern of movement stored in host memory 103 of robot 100. Robot 100 may traverse the portion (e.g., portion 720) of piled granular material (e.g., piled grain 710) in a patternless or random/chaos manner or by following dictates other than a pattern such as by dynamically seeking out areas of slope above a certain measure. In some embodiments, a pattern may be changed or altered based on information sensed by robot 100.

[00113] With continued reference to Figure 8A, at procedure 830 of flow diagram 800, in various embodiments, robot 100 obtains a second measurement of the angle of slope of the portion of piled granular material. This second measurement is obtained after the robot has traversed the portion (e.g., portion 720) of surface 711 following a pattern, for a predetermined period of time, or based on other criteria for re-measurement of the slope. The second angle measurement can be measured and obtained autonomously by robot 100 or can be measured by a device external to robot 100 and then obtained by being communicated to or accessed by robot 100.

[00114] With continued reference to Figure 8A, at procedure 840 of flow diagram 800, in various embodiments, in response to the second measurement satisfying a second condition, robot 100 ceases traversal of the portion of piled granular material. In some embodiments, the first condition is related to a first angle and the second condition is related to a second angle.

[00115] In some embodiments, where the first angle is the same as the second angle, the first condition may be met when the first measurement exceeds the angle, and the second measurement may be met when the second measurement falls below the angle. For example, the angle may be 10 degrees, and when the first measurement is 20 degrees, traversal will continue until the angle is adjusted to below 10 degrees.

[00116] In some embodiments, where the first angle and the second angle are different, the first angle is larger than the second angle. For example, the first angle may be 10 degrees while the second angle is 5 degrees. In such an embodiment, when the first measurement is 20 degrees, traversal will continue until the angle meets the second condition (e.g., drops below 5 degrees).

[00117] With reference to Figure 8B, at procedure 850 of flow diagram 800, in various embodiments, in response to the second measurement failing to satisfy the second condition, the robot 100 continues traversal of the portion of piled granular material. For example, if the second condition specifies that the measurement of slope needs to be reduced to below 5 degrees, the robot would continue traversal of the portion of piled granular material in response to the second measurement being 13 degrees.

[00118] With reference to Figure 8C, at procedure 860 of flow diagram 800, in various embodiments, during traversal of the portion (e.g., 720) of piled granular material by robot 100, a sensor 120 of robot 100 acts under instruction of host processor 102 to capture a measurement of a characteristic of the portion of piled granular. Some example characteristics include, but are not limited to, capturing a measurement of temperature, humidity, moisture, gas composition, electrostatic nature, and/or electrochemical nature. A measured characteristic may also comprise an optical and/or infrared image. The captured measurement of a characteristic can be stored within memory 103 or transmitted from robot 100. In some embodiments, the captured measurement of a characteristic is paired with a location of robot 100 at the time of capture of the measurement. Such paired data can be used to create a characteristic map of the piled granular material which is traversed by robot 100.

[00119] In some embodiments, the captured measurement(s) of characteristic(s) may be transmitted to a base station (506, 605) communicatively coupled with robot 100. The base station (506, 605) is located remotely from the robot and may be configured to communicate the with robot 100 over the Internet, via a wide-area network, via a peer-to-peer communication, or by other means. Via such communications, the base station (506, 605) may receive data collected by robot 100 (including motion sensor data) collected by the robot during the traversal of the portion of piled granular material. Additionally, or alternatively, via such communications, the base station (506, 605) may relay instructions to robot 100. [00120] In some embodiments, the captured measurement(s) of characteristic(s) may be transmitted to a cloud-based 602 storage 603 and/or processing 604 which is/are communicatively coupled with robot 100. The cloud-based infrastructure 602 may be utilized to process data, store data, make data available to other devices (e.g., computer 605), and/or relay information or instructions from other devices (e.g., computer 605) to robot 100. [00121] With reference to Figure 8D, at procedure 870 of flow diagram 800, in various embodiments, a temperature sensor 233, infrared sensor 236, or infrared camera 108 of robot 100 is used to capture a temperature measurement of the portion of piled granular material during the traversal of the portion of piled granular material. In some embodiments, the captured measurement of a characteristic is paired with a location of robot 100 at the time of capture of the temperature measurement. Such paired data can be used to create a heat map of the piled granular material which is traversed by robot 100.

[00122] With reference to Figure 8E, at procedure 880 of flow diagram 800, in various embodiments, robot 100 collects a sample from the portion of piled granular material during the traversal of the portion of piled granular material. For example, with reference to Figure 4A-2, processor 102 or a remotely located operator may direct a sample collection device, such as gatherer payload 342, to open to collect a sample of grain at a particular location and to close after a sample is collected or a predetermined time period has elapsed.

Mapping Piled Granular Material in a Bulk Store

[00123] In various embodiments, for example, device 100 can operate via remote controlled instruction, autonomously, or some combination thereof. Although various embodiments of device 100 are described herein (e.g., device 100, device 100B), it is referred to generically as device 100. Also, as discussed above, device 100 is robotic and may be referred to as a “robot” (e.g., “robot 100”) or as a “robotic device,” (e.g., “robotic device 100”) or the like. Device 100 includes an auger-based drive system which facilitates the movement and/or operation of the device 100 in relation to a portion of piled granular material (e.g., grain) in a bulk store 700, such as a grain bin.

[00124] A device 100, may record its location in three-dimensions as it traverses a surface 711 of a piled granular material 710 in a bulk store 700. For example, three- dimensional positions may be recorded during any traversal, such a random traversal, a traversal in a pattern such as the example patterns illustrated in Figures 7D-7F, or during a pattern executed purposefully for mapping or surface management as illustrated in Figure 9A-9C. The positions may be stored and later or on-the-fly assembled into a three- dimensional map of the surface 711 of the piled granular material 710 (e.g., grain). The assembly of the map may be performed by the device 100, or the positions may be communicatively coupled such as by wireless communication to an external computer system 506 located remotely from the device. The external computer system 506 may then assemble the recorded locations into a three-dimensional map of the surface 711 of the piled granular material 710 (e.g., grain).

[00125] Positions of device 100 may be acquired by any suitable means, including but not limited to: differential Global Navigation Satellite System (GNSS) positioning, real-time kinematic GNSS positioning, triangulation from at least two known points marked inside and/or outside the bulk store 710 (e.g., by optically, sonically, ultrasonically, or via radio signals measuring angle and distance to the known points); using motion sensors 220 and additionally a barometric sensor 239 as an internal inertial measurement unit (IMU) to navigate from a known starting location; and receiving a position communicated (wirelessly) from an external source such as a camera or laser measuring device mounted to the internal roof or upper wall of a bulk store (e.g., bulk store 700). In various embodiments, more than one positioning means may be used.

[00126] The three-dimensional map may be assembled by plotting the recorded locations, such as on a three-dimensional graph with X, Y, and Z axis. This three- dimensional map may be viewed in any desired orientation or view and may be overlaid on a depiction of the bulk store 700 in which the assembled positions were recorded. In some embodiments, the three-dimensional map may be used to determine how much, if any, leveling needs to be performed on a surface 711 of a piled granular material 710. In some embodiments, when coupled with a known location of a bottom surface of a bulk store 700 (such as a grain bin), the volume between the mapped three-dimensional surface 711 and the bottom of the bulk store 700 may be calculated by device 100 or the external computer system 506.

[00127] Additionally, during any traversal of piled granular material 710, device 100 may capture one or more environmental characteristics with its sensors (e.g., temperature, humidity, amount of carbon dioxide, a barometric measurement (e.g., a measurement of atmospheric pressure), an optical image to record visible environmental conditions, and an infrared image, among others. For example, one or more sensors 120 of the device 100 may capture measurements of environmental characteristics relative to the piled granular material being traversed by device 100. In some embodiments, such measurements may be taken at locations that are specified by coordinates with respect to the bulk store 700. In some embodiments, such measurements may be taken at intervals of time passed and/or distance traveled. In an example of time separated measurement intervals, an environmental measurement may be taken by one or more of the sensors 120 every 5 seconds, every 10 seconds, or more than once per second (e.g., 2, 3, or 10 times per second) as device 100 traverses. In an example of distance separated measurement intervals, an environmental measurement may be taken by one or more of the sensors 120 each time device 100 has moved a specified distance from a previous location (e.g., every centimeter of travel, every 5 centimeters of travel, every 10 centimeters of travel, every meter of travel, etc.). In some embodiments, the time and/or three-dimensional location of an environmental measurement captured by a sensor 120 is/are noted and stored in conjunction with captured environmental characteristics.

[00128] In some embodiments, device 100 may assemble the captured environmental characteristic(s) onto the three-dimensional surface map of the surface 711 of a piled granular material 710. In other embodiments, device 100 may communicatively couple (e.g., by wireless communication) the environmental characteristics and their respective three- dimensional locations and/or times of capture to external computer system 506 which then assembles them onto the three-dimensional surface map of the surface 711 of a piled granular material 710.

[00129] In some embodiments, multiple three-dimensional maps may be made over time, such as during filling or withdrawal of piled granular material 710 from the bulk store 700. These maps may be combined to form a three-dimensional map of the captured environmental characteristics of the piled granular material 710. The assembly of multiple surface maps in this manner may accomplished by device 100 or computer system 506, or other computing system which is supplied with the captured environmental characteristics and respective three-dimensional locations of capture.

[00130] Referring now to Figures 9A-9B, a plurality of patterns 930A, 930B, and 930B are illustrated, in accordance with some embodiments. The patterns may be used for surface mapping an/for surface management (e.g., such as breaking up crusts and or grain bridges). For example, with reference to Figure 7H and Figure 9A, device 100 may start at location 931 A and follow the pattern 930 A as illustrated by the dashed lines and directional arrows until endpoint 932A is reached. As discussed previously, locations of device 100 may be recorded in three-dimensions during the traversal in the mapping pattern 930 A upon surface 711C. In some embodiments, one or more types of environmental characteristics may be captured (and their respective three-dimensional locations recorded/noted) during the traversal of the mapping pattern 930A of surface 711C. It should be appreciated that the mapping patterns illustrated in Figures 9A-9C are only examples and that other mapping patterns including crossing mapping patterns and ad-hoc and/or structured patterns which occur during surface leveling or other traversing of a surface of piled granular material. [00131] With reference to Figure 7J and Figure 9B, device 100 may start at location 93 IB and follow the pattern 930B as illustrated by the dashed lines and directional arrows until endpoint 932B is reached. As discussed previously, locations of device 100 may be recorded in three-dimensions during the traversal in the mapping pattern 930B upon surface 71 IE. In some embodiments, one or more types of environmental characteristics may be captured (and their respective three-dimensional locations noted) during the traversal of the mapping pattern 930B of surface 71 IE.

[00132] With reference to Figure 7L and Figure 9C, device 100 may start at location 931C and follow the pattern 930C as illustrated by the dashed lines and directional arrows until endpoint 932C is reached. As discussed previously, locations of device 100 may be recorded in three-dimensions during the traversal in the mapping pattern 930C upon surface 711G. In some embodiments, one or more types of environmental characteristics may be captured (and their respective three-dimensional locations noted) during the traversal of the mapping pattern 930C of surface 711G.

[00133] Figure 10A illustrates a three-dimensional map 1010A of the surface 711C of the piled granular material 710 of Figure 7H assembled from three-dimensional locations of device 100 recorded during traversal of the surface 711C in a mapping pattern (e.g., pattern 930 A), according to an embodiment.

[00134] Figure 10B illustrates a three-dimensional map 1010B of the surface 711C and two types of environmental characteristics of the piled granular material 710 of Figure 7H assembled from three-dimensional locations of device 100 recorded during traversal of the surface 711C in a mapping pattern (e.g., pattern 930A), according to an embodiment. For example, squares 1011 represent captured temperature measurements and their respective locations of capture; while triangles 1012 represent captured relative humidity measurements and their respective locations of capture. It should be appreciated that the moisture content of a granular material (e.g., a grain) can be mathematically calculated from temperature and humidity measurements captured at approximately the same location, and in this manner, a three-dimensional map of grain moisture can be similarly assembled.

[00135] Figure 10C illustrates a three-dimensional map 1010C of the surface 71 IE of the piled granular material 710 of Figure 7J assembled from three-dimensional locations of device 100 recorded during traversal of the surface 71 IE in a mapping pattern (e.g., pattern 930B), according to an embodiment.

[00136] Figure 10D illustrates a three-dimensional map 1010D of the surface 71 IE and two types of environmental characteristics of the piled granular material 710 of Figure 7J assembled from three-dimensional locations of device 100 recorded during traversal of the surface 71 IE in a mapping pattern (e.g., pattern 930B), according to an embodiment. For example, squares 1011 represent captured temperature measurements and their respective locations of capture; while triangles 1012 represent captured relative humidity measurements and their respective locations of capture. It should be appreciated that the moisture content of a granular material (e.g., a grain) can be mathematically calculated from temperature and humidity measurements captured at approximately the same location, and in this manner, a three-dimensional map of grain moisture can be similarly assembled.

[00137] Figure 10E illustrates a three-dimensional map 1010E of the surface 711G of the piled granular material 710 of Figure 7L assembled from three-dimensional locations of device 100 recorded during traversal of the surface 711G in a mapping pattern (e.g., pattern 930C), according to an embodiment.

[00138] Figure 10F illustrates a three-dimensional map 1010F of the surface 711G and two types of environmental characteristics of the piled granular material 710 of Figure 7L assembled from three-dimensional locations of device 100 recorded during traversal of the surface 711G in a mapping pattern (e.g., pattern 930C), according to an embodiment. For example, squares 1011 represent captured temperature measurements and their respective locations of capture; while triangles 1012 represent captured relative humidity measurements and their respective locations of capture. It should be appreciated that the moisture content of a granular material (e.g., a grain) can be mathematically calculated from temperature and humidity measurements captured at approximately the same location, and in this manner, a three-dimensional map of grain moisture can be similarly assembled. A variety of such moisture calculations exist for different grains, and are known in the art.

[00139] Figure 10G illustrates a three-dimensional map 1010F of the surface 711G and the overall pile of piled granular material 710 made by mapping during the filling illustrated in Figures 7G-7L along with two types of environmental characteristics (1011 and 1012) of the piled granular material, according to an embodiment. For example, three-dimensional maps 1010B, 1010D, and 1010E can be combined to provide a mapping of environmental characteristics on the surface of and within piled granular material 710 of Figure 7L.

[00140] Average elevations of the floor of the bulk store (elevation 1050) and elevations of surfaces (elevations 1051, 1052, and 1053) associated with various load-ins of grain are depicted. For example, the map of the first surface leveled load-in associated with surface 711C has an average elevation 1051; the map of the second surface leveled load-in of grain associated with surface 71 IE has an average elevation 1052; and the map of the third surface leveled load-in of grain associated with surface 711G has an average elevation 1053. [00141] Although three three-dimensional maps have been illustrated as being recorded/captured/assembled in conjunction with piled granular material 710, it is appreciated that a greater or lesser number may be recorded/captured/assembled in other embodiments. For example, a three-dimensional map of environmental characteristics of granular material 710 may be made for every 1cm, 5 cm, 10cm, etc. change in height of granular material 710 such that one or more environmental characteristics of a pile of granular material 710 are mapped in a plurality of three-dimensional map slices.

Example Uses of Mapping

[00142] In some embodiments, a three-dimensional mapping of the surface 711 of a pile of granular material can be used in conjunction with information about the piled granular material (e.g., moisture profiles and/or estimates) and/or information about the bulk store (such as the elevation of the floor) to estimate a volume of piled granular material 710 between the surface 711 and the floor.

[00143] In some embodiments, one or more three-dimensional mapping of the surface 711 of may be created during the filling granular material, thus creating a plurality of slice type mappings of granular material within the pile. In an embodiment where one or more environmental characteristics are also captured in conjunction with the three-dimensional mapping, environmental characteristics are also mapped in slice maps which provide a three- dimensional mapping of the captured environmental characteristic(s) within the pile.

[00144] Using the three-dimensional surface mappings, a volume of granular material between two slice maps in a pile or associated with a single slice map in a pile can be accurately tracked as it is removed in response to removing granular material from the top of the pile within the bulk store (when unloading from the bottom a funnel effect causes grain to funnel downward from the top surface, so unloading is typically last-in, first-out). In this manner, a particular volume of granular material associated with certain mapped environmental characteristics can be tracked so that it can be processed in a desired way. That is, because it is knowable and trackable when certain mapped granular material will be accessed and removed and how much granular material needs to be removed to access it, the mapped granular material may be set aside (upon removal) for disposal if it possesses undesirable environmental characteristics. Similarly, because it is knowable when mapped granular material will be accessed and removed, the mapped granular material may be: routed (upon removal) for sale to a particular client who desires the mapped environmental characteristics associated with the volume of granular material; sold for an increased price if it possesses desirable mapped environmental characteristics; and/or presold to a particular client based upon the mapped environmental characteristics. For example, and with reference to 1000G of Figure 10G an overall volume of grain can be estimated by finding the volume of a cylinder with a radius of half the diameter of bulk store 700 and a height equivalent to the elevation 1053 minus elevation 1050. This works when the successive load-ins are leveled to within a few degrees of 0. Similarly, a volume for any of the load-ins can be calculated by finding the cylindrical volume between the surface of the last load-in and the surface of the load-in being estimated. When precise slopes are known of leveled surfaces of each load-in, those slopes can be incorporated to further refine the estimate, such as by calculating a cylindrical volume and adding on the volume of a shallow cone.

Delivery of Payloads in a Bulk Store

[00145] A device 100, such as a robot, may precisely deliver and retrieve payloads within a bulk store (e.g., bulk store 700) for granular material. The payload may be any desired payload which can be carried by the device 100, numerous of which have been discussed previously, and may include a sensor (e.g., a temperature sensor, a humidity sensor, an elevation sensor, or some combination of sensors) or a probe which includes one or more of these sensors and is configured to record and/or wirelessly communicate information measured by the sensors. In various embodiments, a probe may collect information about the granular material (grain) which proximally surrounds it (e.g., the temperature local to the probe). In various embodiments, for example, device 100 can operate via remote controlled instruction, autonomously, or some combination thereof. As discussed above, device 100 is robotic and may be referred to as a “robot” or as a “robotic device,” and includes an augerbased drive system which facilitates the movement and/or operation of the device in relation to a portion of piled granular material in a bulk store 700, such as a grain bin. The robotic device can be equipped with a payload delivery system allowing the precise placing of a payload such as a probe, including location coordinates within the bulk store. In some embodiments, this location is marked and stored in the payload during delivery and or in the robotic device 100 upon delivery of the payload. For example, the robot maneuvers on the granular material with its auger driven propulsion and using an adaptable tool or a probe delivery module which may be carried in payload bay 440 (e.g., probe delivery payload 344) or elsewhere on device 100, delivers the probe, and marks the probe’s location upon delivery/deposition onto the granular material. An adaptable tool can deliver a variety of probes, while a probe delivery module may be configured for delivering and/or retrieving a specific type of probe.

[00146] One embodiment of a probe delivery payload 344 is illustrated in Figures

11 A-l IE, it is appreciated that any suitable probe delivery payload may be similarly utilized and that the embodiment of Figures 11 A-l IE is provided by way of example and not of limitation.

[00147] Figure 11 A illustrates a top view of an example probe delivery payload 344 which may be coupled to and controlled by a device 100 which moves about and/or operates in relation to a pile of granular material, in accordance with various embodiments.

[00148] Figure 1 IB illustrates a front view of an example probe delivery payload 344 which may be coupled to and controlled by a device 100, in accordance with various embodiments. The rear view is substantially the same.

[00149] Figure 11C illustrates a bottom view of an example probe delivery payload 344 which may be coupled to and controlled by a device 100, in accordance with various embodiments. A plurality of doors 1101 (1101-1, 1101-2, 1101-3, 1101-4, 1101-5, 1101-6, 1101-7, 1101-8, 1101-9) are depicted, but a greater or lesser number may be used in various embodiments. Each of the doors 1101 may be independently opened by a device 100, or a processor thereof, such as by actuating a solenoid which hold a particular door in a closed position.

[00150] Figure 1 ID illustrates a right side view of an example probe delivery payload 344 which may be coupled to and controlled by a device 100, in accordance with various embodiments. The left side view is a mirror image thereof.

[00151] Figure 1 IE illustrates a right side view of an example probe delivery payload 344 which may be coupled to and controlled by a device 100, in accordance with various embodiments. In Figure 1 IE, door 1101-1 has been opened by a device 100 (not depicted in Figure 1 IE), freeing a payload 1110 to be dropped via gravity. Payload 1110 may be a probe which is left behind after it lands on a surface upon which a device 100 is operating.

[00152] Figure 12 illustrates a right elevational view of the exterior of a device 100B which moves about and/or operates in relation to a pile of granular material 710, in accordance with various embodiments. Device 100B is similar to device 100 illustrated in Figure 4C-2, except that probe delivery payload 344 has been coupled to its rear and communicatively coupled to a host processor 102 which exerts control over which doors 1101 to open and when to open them in order to precisely deliver a payload 1110. [00153] Several methods of payload delivery are described in conjunction with description of Figures 13, 14, and 15. It should be appreciated that although these methods are described in isolation for purposes of clarity, they may be used in various combinations with one another. For example, while probes are being delivered according to a predetermined pattern, a device 100 (e.g., device 100B) may deliver an individual probe in a place which is not specified by the pattern in response to receiving remote controlled instructions to do so and/or in response to sensing specified criteria which satisfy a requirement for delivery of a probe.

[00154] A pattern for probe delivery may be the same pattern (or a portion thereof) used to level a piled granular material in a bin or other store. For example, during the leveling probes may be dispensed at designated locations which may be manually selected, predetermined/preprogrammed, and/or in response to meeting of sensed criterial (e.g., one or some combination of location, temperature measured, air flow measured, moisture of granular material measured, etc.). That is, while leveling piled granular material, a device 100B may encounter locations or criteria which dictate triggering of payload delivery. In this manner, payload delivery may, in some embodiments, occur coincident with other activities of device 100B.

[00155] Figure 13 illustrates robot delivery of a payload 1110, which may be a probe, in a bulk store in a predetermined three-dimensional pattern as granular material such as grain is added to the bulk store 700, according to various embodiments. Bulk store is shown as a three-dimensional side section view, similar to section A-A of Figure 7B. Dashed discs 1301, 1302, and 1303 (shown in Figures 13, 14, and 15) represent maps of surfaces at different levels within a pile of piled granular material 710.

[00156] In Figure 13, device 100B is illustrated delivering a plurality of probes 1110 (e.g., 1110-1 through 1110-15) over a period of time as grain has been loaded through top loading portal 701 of bulk store 700 to form a pile 710 of granular material (e.g., a pile of grain). For example, at the level represented by disk 1301, at the beginning of the loading of grain, device 100B delivered probes 1110-1 and 1110-2 according to a specified and predetermined, spaced out pattern. At level represented by disk 1302, after more grain has been loaded atop the level represented by disk 1301 of piled granular material 710, device 100B delivered probes 1110-3 through 1110-7 according to a specified and predetermined, spaced out pattern (which may be the same or different than the pattern employed on the level represented by disk 1301). At level represented by disk 1303, after more grain has been loaded atop the level represented by disk 1302 of the piled granular material 710, device 100B delivered probes 1110-8 through 1110-15 according to a specified and predetermined, spaced out pattern (which may be the same or different than the pattern employed on the level represented by disk 1301 and/or on the level represented by disk 1302). In the illustrated embodiment, probe 1110-15 has just been delivered relative to a preprogramed position on piled granular material 710.

[00157] In some embodiments, a method of probe delivery in a predetermined pattern within a bulk store, such as a grain bin may include some of the following procedures. A probe 1110, or set of probes 1110, is loaded into the probe delivery payload 344 of device 100B. The device 100B is given instructions on where to deliver the probes via a pattern selection in its programmable memory 103. The device 100B is placed in the bulk store 700 facility (or on a pile of granular material 710). Granular material (e.g., grain) begins to be loaded into the bulk store 700 and/or onto the pile 710, in some embodiments. The device 100B performs a series of maneuvers on the surface of the granular material to position itself with respect to the pattern which it is executing by traversing the piled granular material 710 (which may be in the process of loading such as through a top loading portal 701). A probe 1110 is placed by the device 100B (e.g., by controlling dispensation of the probe 1110 from the probe delivery payload 344) in the precise location when the device 100B arrives through its maneuvering at a predetermined location in the programmed pattern. In some embodiments, the location is marked by device 100B with the probe identification (e.g., a serial number or other number assigned to the dispensed probe 1110) position coordinates at the time of the delivery. Inside of a bulk store 700, the position may be realized by triangulation to beacons or other suitable means such as overhead video tracking. As part of the marking, the probe identification and/or position may be stored in a memory of device 100B and or wirelessly transmitted by device 100B. In the same manner, according to the preprogrammed pattern, one or more additional probes 1110 may be placed and, in some embodiments, may have their probe identification and placed position coordinates marked (i.e., recorded by device 100B and/or wirelessly transmitted by device 100B).

[00158] Figure 14 illustrates robot delivery of a payload 1110, which may be a probe, by a device 100B in a bulk store 700 when triggered by detection of specified criteria, according to various embodiments. In Figure 12, device 100B is illustrated delivering a probe 1110-1 to a specific preprogrammed location 1410 which may be a two-dimensional location or a three-dimensional location (where the third dimension is elevation). The location may be specified as an exact set of coordinates or as a small geo-fence within which to deliver the probe 1110-1. A plurality of probes may be delivered in this manner to a plurality of preprogramed locations. The specified criteria discussed above, may be arrival of device 100B at the predetermined location 1410, however additional and/or different specified criteria may determine when/where a probe 1110-1 is delivered. For example, device 100B may deposit a temperature sensing probe 1110 upon device 100B sensing a temperature of grain in a locality of granular material it is traversing meeting a specific criteria (e.g., exceeding a threshold temperature).

[00159] In some embodiments, a method of probe delivery within a bulk store 700, such as a grain bin, in response to detection of specified criteria may include some of the following procedures. The probe 1110, or set of probes, is loaded into the probe delivery payload 344 of device 100B. Device 100B is placed in the bulk store facility 700 (or on a pile of granular material 710). Granular material (e.g., grain) begins to be loaded into the bulk store 700 and/or onto the pile 710, in some embodiments. The device 100B performs a series of maneuvers on the surface of the piled granular material 710 to position itself, where the maneuvers may be automated, based on stored instructions (e.g., a pattern), based on human remote control, or some combination thereof. The device 100B performs a series of readings with on-board sensors. The probe 1110 is placed in the specific location when the sensor readings detect a predetermined condition (i.e., the specified criteria, such as grain temperature exceeding a preestablished threshold) and the device 100B triggers the delivery instructions to effect dispensation of a probe from the probe delivery payload 344. In some embodiments, the location is marked by device 100B with the probe identification (e.g., a serial number or other number assigned to the dispensed probe 1110) position coordinates at the time of the delivery. Inside of a bulk store 700, the position may be realized by triangulation to beacons or other suitable means such as overhead video tracking. As part of the marking, the probe identification and/or position may be stored in a memory of device 100B and or wirelessly transmitted by device 100B. In the same manner, one or more additional probes 1110 may be placed and, in some embodiments, may have their probe identification and placed position coordinates marked (i.e., recorded by device 100B and/or wirelessly transmitted by device 100B).

[00160] Figure 15 illustrates robot delivery of a payload 1110, which may be a probe, in a bulk store 700 when triggered by human engagement, according to various embodiments. For example, a human 1510 may utilize a remote controller 501 to send wireless signals 1520 to device 100B and receive signals 1530 from device 100B. In Figure 13, device 100B is illustrated delivering a probe 1110-1 upon receiving instructions from human 1510 which are sent via remote controller 501 or by other suitable means. In some embodiments, a signal 1530 may be wirelessly sent to remote controller 501, or elsewhere, with the identification and marked location of a dispensed probe 1110-1.

[00161] In some embodiments, a method of probe delivery within a bulk store 700, such as a grain bin, in response to direction by human remote control may include some of the following procedures. The probe 1110, or set of probes, is loaded into the probe delivery payload 344 of device 100B. The device 100B is placed in the bulk store facility 700 (or on a pile of granular material 710). Granular material (e.g., grain) begins to be loaded into the bulk store 700 and/or onto the pile 710, in some embodiments. The device 100B performs a series of maneuvers on the surface of the granular material to position itself, where the maneuvers may be automated, based on stored instructions (e.g., a pattern), based on human remote control, or some combination thereof. The device 100B is maneuvered by human remote control to a location where it is desired to place a probe 1110. The probe 1110 is placed in the specific location when the human remotely triggers device 100B to provide delivery instructions to effect dispensation of a probe 1110 from the probe delivery payload 344. In some embodiments, the location is marked by device 100B with the probe identification (e.g., a serial number or other number assigned to the dispensed probe 1110) position coordinates at the time of the delivery. Inside of a bulk store 700, the position may be realized by triangulation to beacons or other suitable means such as overhead video tracking. As part of the marking, the probe identification and/or position may be stored in a memory of device 100B and or wirelessly transmitted by device 100B. In the same manner, human remote instruction may be used to control device 100B to maneuver and place one or more additional probes and may have their probe identification and placed position coordinates marked (i.e., recorded by device 100B and/or wirelessly transmitted by device 100B).

Piled Grain Surface Management

[00162] Figures 16A-16D illustrate a flow diagram 1600 of an example method of surface management of piled grain, in accordance with various embodiments. Procedures of the methods illustrated by flow diagram 1600 of Figures 16A-16D will be described with reference to elements and/or components of one or more of Figures 1-15. It is appreciated that in some embodiments, the procedures may be performed in a different order than described in a flow diagram, that some of the described procedures may not be performed, and/or that one or more additional procedures to those described may be performed. Flow diagram 1600 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g., host processor 102 or any processor of device 100 or a computer or system to which device 100 is communicatively coupled) under the control of computer- readable and computer-executable instructions that are stored on non-transitory computer- readable storage media (e.g., host memory 103, other internal memory of device 100, or memory of a computer or system to which device 100 is communicatively coupled). It is further appreciated that one or more procedures described in flow diagram 1600 may be implemented in hardware, or a combination of hardware with firmware and/or software. [00163] For purposes of example only, the devices 100 and 100B (generically referred to as “device 100” and/or “device 100”) is a robotic device which utilizes augers (403) to move and maneuver with respect to piled granular material, such as, but not limited to piled grain. Robot 100 will be described as operating on or in relation to piled grain in a bulk store, such as, but not limited to grain in a grain bin. In some embodiments, the robot 100 is free of mechanical coupling with a structure (e.g., the bulk store) in which the piled grain is contained. For example, in some embodiments, there is no tether or safety harness coupling the robot 100 to the grain storage bin and it operates autonomously or under wireless remote control. In some embodiments, robot 100 performs the method of flow diagram 1600 completely autonomously. In some embodiments, robot 100 performs the method of flow diagram 1600 semi-autonomously such as by measuring a slope of grain, sending the slope to an external computer system which then determines a pattern for robot 100 to autonomously execute when traversing the piled grain. In some embodiments, robot 100 performs the method of flow diagram 1600 semi-autonomously such as by receiving a remotely measured slope of grain, then autonomously determining a pattern for robot 100 to autonomously execute when traversing the piled grain.

[00164] With reference to Figure 16A, at procedure 1610 of flow diagram 1600, in various embodiments, a robot 100 which includes a processor 102, a memory 103, and an auger-based drive system (e.g., augers 403) receives, instructions to traverse a surface of piled grain in a bulk store. In some embodiments, the instructions may be received wirelessly from a remotely located computer system (506, 605, 604, etc.) or wirelessly from a remote controller 501 operated by a human (i.e., a human may drive the robot 100 remotely). In some embodiments, the instructions may be preprogrammed into robot 100. In some embodiments, the instructions are for the robot 100 to follow a predetermined pattern of movement to traverse the surface of the piled grain.

[00165] With continued reference to Figure 16A, at procedure 1620 of flow diagram 1600, in various embodiments, a processor (e.g., processor 102) of robot 100 controls movement of robot 100 according to the instructions. Via commands to motor controllers 105 and/or drive motors 106 of an auger-based drive system, the robot 100 is controlled to traverse a surface of piled grain 710 in a bulk store 700. As a result of the traversal, a crust layer of the surface is broken up by auger rotation of the auger-based drive system during the traversal. That is, the augers churn the surface of the piled grain 710 to a depth of one to several inches (e.g., 3-12 inches), thus breaking up surface crust and crust which may form a grain bridge over a void in the piled grain 710. Breaking the crust in this manner allows grain below the crust to dry more evenly and prevents spoilage that can result from the crust on the surface. Additionally, breaking up crusts which are part of a grain bridge assists in the flow of the grain when the grain is removed from the bulk store and improves human safety, should a human need to enter and walk upon the surface of the piled grain 710. The traversal may be according to a pattern, many of which have been depicted and described herein. [00166] With continued reference to Figure 16A, at procedure 1630 of flow diagram 1600, in various embodiments, robot 100 the processor directs, according to the instructions, traversal by the robot of a sloped portion of the piled grain to incite sediment gravity flow in the sloped portion of piled grain by disruption of viscosity of the sloped portion of piled grain through agitation of the sloped portion of the piled grain by the auger rotation of the augerbased drive system, wherein the sediment gravity flow reduces a slope of the sloped portion. As described herein, the sediment gravity flow is, effectively, a purposely induced landslide. The sloped portion may be sought out by the robot 100, in some embodiments. In some embodiments, the traversal of one or more sloped portions is repeated to bring reduce the slope of the sloped portion more toward level, which may be realized by bringing the slope below a threshold slope such between +/- 5 degrees, between +/- 4 degrees, +/- 2 degrees, or +/- 1 degree. In some embodiments, the traversal of one or more sloped portions is repeated to bring reduce the slope of the sloped portion more toward level by reducing the slope by a predetermined amount such as 3 degrees, 5 degrees, 10 degrees, etc.

[00167] With reference to Figure 16B, at procedure 1640 of flow diagram 1600, in various embodiments, during traversal of a portion (e.g., portion 720) of piled grain by robot 100, a sensor 120 of robot 100 acts under instruction of host processor 102 to capture a measurement of a characteristic of the portion of piled granular. Some example characteristics include, but are not limited to, capturing a measurement of: temperature, humidity, moisture, gas composition, electrostatic nature, and/or electrochemical nature. A measured characteristic may also comprise an optical and/or infrared image. The captured measurement of a characteristic can be stored within memory 103 or transmitted from robot 100. In some embodiments, the captured measurement of a characteristic is paired with a location of robot 100 at the time of capture of the measurement. Such paired data can be used to create a characteristic map of the piled grain which is traversed by robot 100.

[00168] In some embodiments, the captured measurement(s) of characteristic(s) may be transmitted to a base station (506, 605) that is/are communicatively coupled with robot 100. The base station (506, 605) is located remotely from the robot and may be configured to communicate the with robot 100 over the Internet, via a wide-area network, via a peer-to-peer communication, or by other means. Via such communications, the base station (506, 605) may receive data collected by robot 100 (including motion sensor data) collected by the robot during the traversal of the portion of piled grain. Additionally, or alternatively, via such communications, the base station (506, 605) may relay instructions to robot 100.

[00169] In some embodiments, the captured measurement(s) of characteristic(s) may be transmitted to a cloud-based 602 storage 603 and/or processing 604 which is/are communicatively coupled with robot 100. The cloud-based infrastructure 602 may be utilized to process data, store data, make data available to other devices (e.g., computer 605), and/or relay information or instructions from other devices (e.g., computer 605) to robot 100. [00170] With reference to Figure 16C, at procedure 1650 of flow diagram 1600, in various embodiments, a temperature sensor 233, infrared sensor 236, or infrared camera 108 of robot 100 is used to capture a temperature measurement of a portion (e.g., portion 720) of piled grain during the traversal of the portion of piled grain. In some embodiments, the captured measurement of a characteristic is paired with a location of robot 100 at the time of capture of the temperature measurement. Such paired data can be used to create a heat map of the piled grain which is traversed by robot 100. Additionally, temperature data can provide an operator of the bulk store information about the conditions of storage, quality of grain, and/or identify areas for additional traversal to prevent crust formation and ensure air circulation.

[00171] With reference to Figure 16D, at procedure 1660 of flow diagram 1600, in various embodiments, a probe delivery payload 344 delivers a probe 1110 onto a surface of the piled grain 710. As described herein, the probe may have sensor which measure and report conditions of the grain. The probe may be delivered during load-in of grain, and thus become buried in grain. This may facilitate, over time, positioning of probes which provide measurements at different levels within a column of piled grain 710. Such delivery of probes may be based on preprogrammed positions in a patter, coordinate locations, human direction, or automated response of robot 100B upon detecting a particular characteristic (e.g., grain temperature above a preset threshold).

Mapping Within a Bulk Store of Granular Material

[00172] Figures 17A-17D illustrate a flow diagram 1700 of an example method of mapping within a bulk store (e.g., bulk store 700 or other bulk store) of granular material, in accordance with various embodiments. Procedures of the methods illustrated by flow diagram 1700 of Figures 17A-17D will be described with reference to elements and/or components of one or more of Figures 1-15. It is appreciated that in some embodiments, the procedures may be performed in a different order than described in a flow diagram, that some of the described procedures may not be performed, and/or that one or more additional procedures to those described may be performed. Flow diagram 1700 includes some procedures that, in various embodiments, are carried out by one or more processors (e.g., host processor 102 or any processor of device 100 or a computer or system to which device 100 is communicatively coupled) under the control of computer-readable and computer-executable instructions that are stored on non-transitory computer-readable storage media (e.g., host memory 103, other internal memory of device 100, or memory of a computer or system to which device 100 is communicatively coupled). It is further appreciated that one or more procedures described in flow diagram 1700 may be implemented in hardware, or a combination of hardware with firmware and/or software.

[00173] For purposes of example only, the devices 100 and 100B (generically referred to as “device 100” and/or “device 100”) is a robotic device which utilizes augers (403) to move and maneuver with respect to piled granular material, such as, but not limited to piled grain. Robot 100 will be described as operating on or in relation to piled grain in a bulk store, such as, but not limited to grain in a grain bin. In some embodiments, the robot 100 is free of mechanical coupling with a structure (e.g., the bulk store) in which the piled grain is contained. For example, in some embodiments, there is no tether or safety harness coupling the robot 100 to the grain storage bin and it operates autonomously or under wireless remote control. In some embodiments, robot 100 performs the method of flow diagram 1700 completely autonomously. In some embodiments, robot 100 performs the method of flow diagram 1700 semi-autonomously such as by measuring a slope of grain, sending the slope to an external computer system which then determines a pattern for robot 100 to autonomously execute when traversing the piled grain. In some embodiments, robot 100 performs the method of flow diagram 1700 semi-autonomously such as by receiving a remotely measured slope of grain, then autonomously determining a pattern for robot 100 to autonomously execute when traversing the piled grain.

[00174] With reference to Figure 17A, at procedure 1710 of flow diagram 1700, in various embodiments, a robot 100 which includes a processor 102, a memory 103, and an auger-based drive system (e.g., augers 403), the robot traverses, a first surface (e.g., 71 IB of Figure 7G) of a piled granular material 710 in a bulk store (e.g., bulk store 700) in a mapping pattern (pattern 730, pattern 731, pattern 732, etc.). Numerous patterns which may be used for mapping are depicted and described herein, and reference is made to the patterns illustrated in Figures 7D, 7E, and 9A-9C which may be used for mapping as well as for other purposes.

[00175] In some embodiment, the traversing comprises robot 100 traversing a first surface of a piled granular material in a bulk store in the mapping pattern and inciting sediment gravity flow of a sloped portion that is traversed. That is, the traversal of the first surface of the piled granular material 710 in this mapping pattern intentionally incites sediment gravity flow in a sloped portion of the piled granular material by disrupting the viscosity of the sloped portion through agitation of the sloped portion of the piled granular material 710 by auger rotation of the auger-based drive system. Effectively, the augers dig several inched into the sloped surface and their agitation lowers the viscosity of the piled granular material 710 in traversed portions. In this manner, the incited sediment gravity flow causes a small avalanche/ slide of the granular material in the sloped portion which is traversed, resulting in a slightly less steep slope after the traversal and the resulting slide of granular material.

[00176] In some embodiments, the traversal of the first surface of the piled granular material in the bulk store occurs while the bulk store is being filled with additional granular material atop the first surface. For example, and with reference to Figure 7A, while granular material (e.g., grain, etc.) is loaded into the top loading portal 701 of bulk store 700, robot 100 may be actively traversing a surface 711 on piled granular material 710 below. In some embodiments, the traversing may also take place while granular material (e.g., grain, etc.) is unloaded by a sump auger at the bottom of bulk store 700. In other embodiments, the traversing may take place between loading and unloading of granular material (e.g., grain, etc.).

[00177] With reference to Figure 17A, at procedure 1720 of flow diagram 1700, in various embodiments, the robot (e.g., robot 100) records a plurality of three-dimensional locations of the robot 100 during the traversal in the mapping pattern. The three-dimensional locations may be recorded together with readings from one or more sensors 120 which are measured at one or more of the three-dimensional points. In this fashion, a three-dimensional location may be assigned to one or more measurements. For example, a plurality of three- dimensional location (and in some embodiments measurements too) may be recorded while traversing surface 711C in pattern 930 A of Figure 9 A.

[00178] With reference to Figure 17A, at procedure 1730 of flow diagram 1700, in various embodiments, the plurality of three-dimensional locations of the robot 100 are assembled into a three-dimensional surface map of the first surface of the piled granular material. In some embodiments, the robot may assemble the three-dimensional locations into the three-dimensional surface map, while in other locations, the three-dimensional locations are transmitted from the robot to an external computer system (e.g., 605, 506, etc.) which may perform the three-dimensional surface map assembly. Figures 10A-10G provide some examples of three-dimensional surface maps which may be assembled. For example, maps 1010A and 1010B may be assembled after traversal of surface 711G in pattern 930 A. In some embodiments, the map(s) may be provided for viewing by a human user on a display. [00179] With reference to Figure 17B, at procedure 1740 of flow diagram 1700, in various embodiments, the method as recited in 1710-1730 further includes: responsive to the bulk store being filled with additional granular material onto the first surface such that a second surface is formed, the robot 100 traverses the second surface in a second mapping pattern. For example, with reference to Figure 9A, a first surface 711C is traversed with a first pattern 930 A and then a second surface 71 IE is traversed with a second pattern 930B. It should be appreciated that other patterns may be utilized for such traversals and that these are referenced by way of example and not of limitation.

[00180] With reference to Figure 17B, at procedure 1742 of flow diagram 1700, in various embodiments, a second plurality of three-dimensional locations of the robot 100 are recorded during the traversal in the second mapping pattern. With reference to Figure 9B, in one embodiment, this comprises robot 100 recording a second plurality of three-dimensional locations while traversing surface 71 IE in pattern 930B.

[00181] With reference to Figure 17B, at procedure 1744 of flow diagram 1700, in various embodiments the second plurality of three-dimensional locations of the robot 100 are assembled into a second three-dimensional surface map of the second surface of the piled granular material. In some embodiments, the robot may assemble the three-dimensional locations into the three-dimensional surface map, while in other locations, the three- dimensional locations are transmitted from the robot to an external computer system (e.g., 605, 506, etc.) which may perform the three-dimensional surface map assembly. For example, maps 1010C and 1010D may be assembled after traversal in pattern 93 OB. The map(s) are depicted with respect to a notional side sectional view of a bulk store. In some embodiments, the map(s) may be provided for viewing by a human user on a display. [00182] With reference to Figure 17C, at procedure 1750 of flow diagram 1700, in various embodiments, the method as recited in 1710-1744 further includes: capturing, by a sensor 120 of the robot 100, a measurement of an environmental characteristic at each of a plurality of the plurality of three-dimensional locations and the plurality of second three- dimensional locations to achieve a plurality of measurements. In some embodiments, this may include capturing one of a temperature measurement (e.g., with temperature sensor 233), a humidity measurement (e.g., with moisture sensor 234), an air flow measurement (e.g., with an air flow sensor), a barometric pressure measurement (e.g., with a barometric sensor 239), a carbon dioxide measurement (e.g., with a carbon dioxide sensor), an optical image (e.g., with optical sensor 235), and an infrared image (e.g. with infrared sensor 236).

[00183] With reference to Figure 17C, at procedure 1752 of flow diagram 1700, in various embodiments one or more measurements of the plurality of measurements are assembled, based on their respective three-dimensional locations of capture, into a three- dimensional map of the environmental characteristics of the bulk store. The assembling may be accomplished by robot 100 or by a computer (e.g., 506, 605, 602) to which robot 100 transmits the plurality of measurements. Figure 10D illustrates a three-dimensional map 1010D with a second plurality of measurements depicted. The map is depicted with respect to a notional side sectional view of a bulk store. In some embodiments, the map may be provided for viewing by a user on a display.

[00184] With reference to Figure 17D, at procedure 1760 of flow diagram 1700, in various embodiments, the method as recited in 1710-1730 further includes: capture, by a sensor 120 of the robot 100, a first measurement of an environmental characteristic at each of a plurality of the three-dimensional locations to achieve a plurality of measurements. In some embodiments, this may include capturing one of a temperature measurement, a humidity measurement, an air flow measurement, a barometric pressure measurement, a carbon dioxide measurement, an optical image, and an infrared image. In some embodiments, this comprises capturing one of a temperature measurement and a humidity measurement, either and both of which can be used to assess condition of grain when the piled granular material is grain. [00185] With reference to Figure 17D, at procedure 1762 of flow diagram 1700, in various embodiments one or more measurements of the plurality of measurements are assembled, based on their respective three-dimensional locations of capture, into a three- dimensional map of the environmental characteristics of the bulk store. The assembling may be accomplished by robot 100 or by a computer (e.g., 506, 605, 602) to which robot 100 transmits the plurality of measurements. Figure 10B illustrates a three-dimensional map 1010B with a first plurality of measurements 1011 depicted. The map 1010B is depicted with respect to a side sectional view of a bulk store. In some embodiments, the map may be provided for viewing by a user on a display.

[00186] With reference to Figure 17E, at procedure 1770 of flow diagram 1700, in various embodiments, the method as recited in 1762 further includes: capture, by a second sensor 120 of the robot 100, a second measurement of a second environmental characteristic at each of a second plurality of the three-dimensional locations to achieve a plurality of second measurements. Where the sensor was one of a temperature sensor 233 and a moisture sensor 234, in some embodiments the second sensor is the other of those two. For example, in an embodiment where the first sensor measures one of temperature and humidity, the second sensor measures the other of temperature and humidity that was not measured by the sensor.

[00187] With reference to Figure 17E, at procedure 1772 of flow diagram 1700, in various embodiments one or more measurements of the plurality of second measurements are assembled, based on their respective three-dimensional locations of capture, into a three- dimensional map of the environmental characteristics of the bulk store. The assembling may be accomplished by robot 100 or by a computer (e.g., 506, 605, 602) to which robot 100 transmits the plurality of measurements. Figure 10B illustrates a three-dimensional map 1010B with a first plurality of measurements 1011 and a second plurality of measurements 1012 depicted. The map is depicted with respect to a notional side sectional view of a bulk store. In some embodiments, the map may be provided for viewing by a user on a display.

Conclusion

[00188] The examples set forth herein were presented in order to best explain, to describe particular applications, and to thereby enable those skilled in the art to make and use embodiments of the described examples. However, those skilled in the art will recognize that the foregoing description and examples have been presented for the purposes of illustration and example only. The description as set forth is not intended to be exhaustive or to limit the embodiments to the precise form disclosed. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

[00189] Reference throughout this document to “one embodiment,” “certain embodiments,” “an embodiment,” “various embodiments,” “some embodiments,” or similar term means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of such phrases in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics of any embodiment may be combined in any suitable manner with one or more other features, structures, or characteristics of one or more other embodiments without limitation.