Optical Memory and Neural Networks Electrical and Electronic Engineering

Intelligent Motion Control of an Underwater Biomimetic Robot Using Deep Reinforcement Learning

Kazantsev, G. V., Stankevich, L. A.
Springer Nature · 2026-10-01 · DOI 10.3103/s1060992x26603489

Abstract

Abstract Control of biomimetic underwater vehicles (BUVs) is complicated by the nonlinearity of hydrodynamics and the lack of accurate analytical models, which limits the application of classical controllers. This paper proposes a control system for a robotic fish with a multi-link caudal fin based on deep reinforcement learning without explicit hydrodynamic modeling. The problem is formalized as a Markov decision process and solved using the Soft Actor-Critic (SAC) algorithm with a multi-component reward function in the Stonefish 2 simulator integrated with ROS2. Experimental results demonstrate that the trained policy achieves a steady-state depth error of 0.07 m with a standard deviation of 0.04 m, a settling time of 22 s, and a maximum velocity of 0.15 m/s while maintaining heading. The results confirm the effectiveness of the proposed approach for developing adaptive control systems for biomimetic underwater vehicles.

Read at publisher →