Satellite-based global positioning systems (GPS or, more generally, GNSS) revolutionized the surface mining industry in the 1980s, 1990s, and early 2000s, possibly representing one of the most significant technological changes to the mining industry in recent history. Today, in conjunction with the advent of high-speed digital and mobile communications, material and fleet tracking systems are commonplace at nearly all surface mining operations. More recently, the number of deployed autonomous haul trucks and robotic surface drills has been increasing, owing their existence to advances in robotics, positioning, and communications technologies all at once.
However, the story is different for underground mining. There exists no directly analogous replacement for satellite-based global positioning systems that works in underground environments. Satellite signals cannot penetrate rock, and placing many radio frequency devices (e.g., RFID tags or Wi-Fi access points) throughout a mine has significant practical drawbacks and is not an elegant solution to the problem. Unfortunately, underground positioning (and underground robotics, in general) had a slow start in the 1990s and early 2000s, when several misconceptions about the state-of-the-art were espoused, for better or for worse. The fact is that practical, real-time, high-accuracy 3D positioning for moving equipment in underground environments is a tricky problem, and one that only recent computing, sensors, and know-how has solved.
This project page provides a summary of the research output from two phases of uGPS (underground positioning system) research funded by the Natural Sciences and Engineering Research Council of Canada (NSERC). Phase 1 focused primarily on localization in 2D, and was carried out with industry partner MDA. Phase 2 focused primarily on 3D mapping and associated practical applications, and was generously supported mostly by Barrick Gold‘s internationally-staffed Mining Information Technology (MIT) group. Together, these research projects supported more than a dozen graduate researchers, many fruitful technical discussions between university researchers and industry professionals, as well as joint field work. This research was directly made into the product called uGPS RapidMapper, now sold and used by mining companies and other professional organizations around the world.
uGPS Phase 1: Mapping and Localization in 2D
The uGPS concept began in 2006 and was based on work by Joshua Marshall and Tim Barfoot on autonomous tramming at MDA, in collaboration with Atlas Copco Rock Drills AB (Örebro, Sweden). This initial work resulted in the development of source intellectual property, owned and patented by MDA.
J. A. Marshall and T. D. Barfoot. Traffic management system for a passageway environment. US Patent No. 7756615 US B2, July 13, 2010. European patent EP1924981B1, granted September 12, 2012.
J. A. Marshall and T. D. Barfoot. Global position and orientation estimation system for a vehicle in a passageway environment. European Patent Application No. EP 2 450 763 A1, filed July 26, 2006.
Beginning in 2008, initially funded by NSERC and MDA, a team from the Robotic Vehicles Group at Carleton University set out devise a map-based solution to the underground positioning problem based on the latest research from the mobile robotics community. This work formed the seed for the new underground positioning technology now called coined uGPS.
Phase 1 Publications & Theses
N. J. Lavigne and J. A. Marshall. A landmark-bounded method for large-scale underground mine mapping. In Journal of Field Robotics, vol. 29, no. 6, pp. 861-879, November/December 2012.
S. Radacina Rusu. Real-time localization in large-scale underground environments using RFID-based node maps. M.A.Sc. thesis, Department of Mechanical and Aerospace Engineering, Carleton University, Ottawa, ON, August 2011.
S. Radacina Rusu, J. A. Marshall, and M. J. D. Hayes. Localization in large-scale underground environments with RFID. In Proceedings of the 24th IEEE Canadian Conference on Electrical and Computer Engineering, pp. 1140-1143, Niagara Falls, ON, May 2011.
U. Artan, J. A. Marshall, and N. J. Lavigne. Robotic mapping of underground mine passageways. In Transactions of the IMM (Part A): Mining Technology, vol. 120, no. 1, pp. 18-24, January 2011.
N. J. Lavigne. A landmark-bounded method for mapping of large-scale underground drift networks. M.A.Sc. thesis, Department of Mechanical and Aerospace Engineering, Carleton University, Ottawa, ON, September 2010.
J. A. Marshall. Navigating the advances in underground navigation. Invited article in CIM Magazine, vol. 5, no. 4, pp. 20-21, June/July 2010.
N. J. Lavigne, J. A. Marshall, and U. Artan. Towards underground mine drift mapping with RFID. In Proceedings of the 23rd IEEE Canadian Conference on Electrical and Computer Engineering, pp. 1-6, Calgary, AB, May 2010.
U. Artan. Algorithms and experiments for globally consistent mapping of underground passageway environments. M.A.Sc. thesis, Department of Mechanical and Aerospace Engineering, Carleton University, Ottawa, ON, January 2010.
uGPS Phase 2: Mapping in 3D with Applications
Following the success of uGPS Phase 1 we received a great deal of interest from Barrick and other industry professionals, not specifically about the localization capability of the uGPS technology but rather about its ability to generate global and accurate maps of underground environments. This feedback formed the impetus for a new phase of research in underground mapping and localization.
In 2010, the short-lived Robotic Vehicles Group at Carleton University moved to Queen’s University and was re-named the Mining Systems Laboratory. In March 2013, a new uGPS project began, this time primarily funded by Barrick Gold‘s Mining Information Technology (MIT) group. Peck Tech Consulting showed an interest in our technology, given that they had recently hired two researchers from the uGPS Phase 1 project (Artan and Lavigne). These students brought the uGPS code and expertise to Peck Tech. An official link was also created with the Robotics and Computer Vision Laboratory at Queen’s, to augment our expertise in the areas of computer vision and the possible use of camera-based sensors for mapping and localization.
This new uGPS research project was divided into several work packages (WPs), each with a specific sub-objective (see publications and links below). At the end of the project (in March 2016), more significant progress had been made one some work packages when compared with others. However, this was as a result of the feedback from our industry partners throughout the project about the directions most interesting and timely to their activities. Some publications are still under review or in press, and are thus not listed yet (check back here for updates in 2017 and beyond).
Mapping
J. Simela. Towards Automated Underground Mine Surveying: Integration of Mobile Mapping with Georeferenced Geometric Beacons. Ph.D. Thesis, The Robert M. Buchan Department of Mining, Queen’s University, January 2016.
M. T. Ahmed, M. Mohamad, J. A. Marshall, and M. Greenspan. Registration of noisy point clouds using virtual interest points. In Proceedings of the 12th Conference on Computer and Robot Vision (CRV 2015), Halifax, NS, June 2015. Best vision paper award!
J. V. Simela, J. A. Marshall, and L. K. Daneshmend. Automated laser scanner 2D positioning and orienting by method of triangulateration for underground mine surveying. In Proceedings of the 30th International Symposium on Automation and Robotics in Construction and Mining, Montreal, QC, August 2013. [funded by NSERC Discovery]
Real-Time Localization
E. Deretey. Visual Localization in Underground Mines and Indoor Environments using PnP. M.A.Sc. Thesis, Department of Electrical and Computer Engineering, Queen’s University, January 2016.
E. Deretey, M. T. Ahmed, J. A. Marshall, and M. Greenspan. Visual indoor positioning using a single camera. In Proceedings of the 6th International Conference on Indoor Positioning and Indoor Navigation (IPIN 2015), pp. 1-9, Banff, AB, October 2015.
D. Sinha. Image Retrieval using Landmark Indexing for Indoor Navigation. M.A.Sc. Thesis, Department of Electrical and Computer Engineering, Queen’s University, April 2014.
D. Sinha, T. Ahmed, and M. Greenspan. Image retrieval using landmark indexing for indoor navigation. Proceedings of the Canadian Conference on Computer and Robot Vision (CRV 2014), Montreal, QC, May 2014.
Automated Map Annotation
C. Watson and J. A. Marshall. Estimating underground mine ventilation friction factors from low-density 3D data acquired by a moving LiDAR. To appear in the International Journal of Mining Science and Technology, accepted June 2, 2017.
C. Watson. Towards Estimating Friction Factors of Mine Drifts from Low Density Point Clouds. M.A.Sc. Thesis, The Robert M. Buchan Department of Mining, Queen’s University, April 2016.
C. Watson and J. A. Marshall. Towards extracting absolute roughness from underground mine drift profile data. In Proceedings of the 37th International Symposium on the Application of Computers and Operations Research in the Mineral Industry (APCOM 2015), Fairbanks, AK, May 2015.
Change Detection
R. L. Vanderbeck. A Bayesian Approach to Convergence Detection in Underground Excavations using LiDAR. M.A.Sc. Thesis, The Robert M. Buchan Department of Mining, Queen’s University, April 2016.
Vehicle Routing and Ramp Management
M. Pasternak and J. A. Marshall. On the design and selection of vehicle coordination policies for underground mine production ramps. In International Journal of Mining Science and Technology, vol. 26, no. 5, September 2016. DOI: 10.1016/j.ijmst.2016.05.014
D. Haviland and J. A. Marshall. Fundamental behaviours of production traffic in underground mine haulage ramps. In International Journal of Mining Science and Technology, vol. 25, No. 1, pp. 7-14, January 2015. DOI: 10.1016/j.ijmst.2014.11.006
Project Funding
This work was funded in part by the Natural Sciences and Engineering Research Council of Canada (NSERC) as well as MDA Inc. and Barrick Gold Corporation.