Mobile Robot Control using Deep Reinforcement Learning and Autoencoder in Dynamic Environment
DOI:
https://doi.org/10.70063/techcompinnovations.v2i2.110Keywords:
DDPG Algorithm, Autoencoder, Mobile Robot, Path Planning, Dynamic EnvironmentAbstract
In recent years, with the rapid development of artificial intelligence, many innovative changes have been made in the field of intelligent mobile robot development. In the field of control and navigation of mobile robots, learning-based methods have many advantages over traditional ones. The study of mobile robot control methods using deep reinforcement learning is a remarkable area in the development of mobile robots that must operate in dynamic environments. In the previous studies, the proposed robot control algorithms using deep reinforcement learning are mostly based on the given target point and obstacle information, the robot path planning is performed, and the corresponding control is based on the obtained path. The DDPG-based method is a typical example. However, in dynamic environments, DRL based robot path planning requires a state of target point and obstacles information, which leads to a large amount of computation, resulting in extremely long convergence time and even non-convergent cases. In this paper, we propose a new method for mobile robot control in dynamic environment that solves the dimensional problem by extracting the features of the configuration of obstacles using autoencoder and learning the DDPG algorithm based on the obtained features. Simulation results show that the proposed algorithm can effectively solve the mobile robot control problem in dynamic environment.
Downloads
References
Al-Kamil, S. J., & Szabolcsi, R. (2024). Enhancing mobile robot navigation: Optimization of trajectories through machine learning techniques for improved path planning efficiency. Mathematics, 12(12), 1787.
Arora, T., Gigras, Y., & Arora, V. (2014). Robotic path planning using genetic algorithm in dynamic environment. International Journal of Computer Applications, 89(11), 8-12.
Chen, J. (2023). Construction of an Intelligent Robot Path Recognition System Supported by Deep Learning Network Algorithms. International Journal of Advanced Computer Science and Applications, 14(10).
Koren, Y., & Borenstein, J. (1991, April). Potential field methods and their inherent limitations for mobile robot navigation. In Icra (Vol. 2, No. 1991, pp. 1398-1404).
Le, H., Saeedvand, S., & Hsu, C. C. (2024). A Comprehensive Review of Mobile Robot Navigation Using Deep Reinforcement Learning Algorithms in Crowded Environments. Journal of Intelligent & Robotic Systems, 110(4), 158.
Mahadevi, S., Shylaja, K. R., & Ravinandan, M. E. (2014). Memory Based A-Star Algorithm for Path Planning of a Mobile Robot. International Journal of Science and Research, 3(6), 1351-1355.
Oberndorfer, C. (2017). Research on new Artificial Intelligence based Path Planning Algorithms with Focus on Autonomous Driving (Doctoral dissertation, PhD thesis, University of Applied Science Munich).
Ren, Y., & Liu, J. (2022). Automatic Obstacle Avoidance Path Planning Method for Unmanned Ground Vehicle Based on Improved Bee Colony Algorithm. Jordan Journal of Mechanical and Industrial Engineering, 16(1), 11-18.
Rybczak, M., Popowniak, N., & Lazarowska, A. (2024). A survey of machine learning approaches for mobile robot control. Robotics, 13(1), 12.
Singh, R., Ren, J., & Lin, X. (2023). A review of deep reinforcement learning algorithms for mobile robot path planning. Vehicles, 5(4), 1423-1451.
Swingler, A., & Ferrari, S. (2010, December). A cell decomposition approach to cooperative path planning and collision avoidance via disjunctive programming. In 49th IEEE Conference on Decision and Control (CDC) (pp. 6329-6336). IEEE.
Wang, H., Yang, W., Huang, W., Lin, Z., & Tang, Y. (2018, November). Multi-feature fusion for deep reinforcement learning: sequential control of mobile robots. In International conference on neural information processing (pp. 303-315). Cham: Springer International Publishing.
Yang, Y., Juntao, L., & Lingling, P. (2020). Multi‐robot path planning based on a deep reinforcement learning DQN algorithm. CAAI Transactions on Intelligence Technology, 5(3), 177-183.
Yu, Z., Duan, P., Meng, L., Han, Y., & Ye, F. (2022). Multi-objective path planning for mobile robot with an improved artificial bee colony algorithm. Mathematical Biosciences and Engineering: MBE, 20(2), 2501-2529.
Yun JY, Ro KS, Pak JS, et al. Path Planning using DDPG Algorithm and Univector Field Method for Intelligent Mobile Robot. IJARAT 2024; 2(2): 7-11p. doi:10.37591/IJART
Zhu, A., Dai, T., Xu, G., Pauwels, P., De Vries, B., & Fang, M. (2023). Deep reinforcement learning for real-time assembly planning in robot-based prefabricated construction. IEEE Transactions on Automation Science and Engineering, 20(3), 1515-1526.
Zhu, Y., Wan Hasan, W. Z., Harun Ramli, H. R., Norsahperi, N. M. H., Mohd Kassim, M. S., & Yao, Y. (2025). Deep reinforcement learning of mobile robot navigation in dynamic environment: A review. Sensors, 25(11), 3394.
