Dynamic robotic tracking of underwater targets using reinforcement learning

0
135

Abstract

To realize the potential of autonomous underwater robots that scale up our observational capacity in the ocean, new techniques are needed. Fleets of autonomous robots could be used to study complex marine systems and animals with either new imaging configurations or by tracking tagged animals to study their behavior. These activities can then inform and create new policies for community conservation. The role of animal connectivity via active movement of animals represents a major knowledge gap related to the distribution of deep ocean populations. Tracking underwater targets represents a major challenge for observing biological processes in situ, and methods to robustly respond to a changing environment during monitoring missions are needed. Analytical techniques for optimal sensor placement and path planning to locate underwater targets are not straightforward in such cases. The aim of this study was to investigate the use of reinforcement learning as a tool for range-only underwater target-tracking optimization, whose promising capabilities have been demonstrated in terrestrial scenarios. To evaluate its usefulness, a reinforcement learning method was implemented as a path planning system for an autonomous surface vehicle while tracking an underwater mobile target. A complete description of an open-source model, performance metrics in simulated environments, and evaluated algorithms based on more than 15 hours of at-sea field experiments are presented. These efforts demonstrate that deep reinforcement learning is a powerful approach that enhances the abilities of autonomous robots in the ocean and encourages the deployment of algorithms like these for monitoring marine biological systems in the future.

Summary:

I had access to read the abstract of this article (full article required a subscription) and I have found the new technology to be very interesting so I have included it here. It discusses the movement of animals and how underwater autonomous robots can track this movement. These robots are able to track a target underwater with sensors. The usefulness of this new technology is still being evaluated. The advancement of autonomous robots and technology as they relate to other living things could be an important factor in my project.

Works Cited:

Masmitja, I., Martin, M., O’Reilly , T., Kieft, B., Palomeras, N., Navarro , J., & Katija, K. (n.d.). Dynamic robotic tracking of underwater targets using … – science. Dynamic robotic tracking of underwater targets using reinforcement learning. https://www.science.org/doi/10.1126/scirobotics.ade7811