A hybrid deep-Q-network and model predictive control for point stabilization of visual servoing systems
File version
Author(s)
Jin, Z
Liu, A
Yu, L
Yang, F
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
Size
File type(s)
Location
License
Abstract
Major difficulties and challenges of visual servoing point stabilization focus on how to design controllers to efficiently complete the task while satisfying various constraints. This paper designs a hybrid control scheme that combines reinforcement learning and model predictive control to handle the point stabilization problem for image-based visual servoing systems of wheeled mobile robots with the visibility and input constraint. The image plane is divided into two parts: the deep-Q-network (DQN) part and the model predictive control (MPC) part. In the DQN part, a DQN controller incorporating two deep networks is designed and activated to pull the image coordinates of the feature into the MPC part. In the MPC part, a simplified-dual-neural-network-based MPC scheme (SDN-MPC) is proposed to precisely guide the robot to the desired position. The asymptotic stability of the SDN-MPC is proven for the point stabilization task. Finally, simulations and experiments are provided to verify the effectiveness, efficiency and robustness of the proposed hybrid controller by comparing with the MPC-only controller and DQN-only controller.
Journal Title
Control Engineering Practice
Conference Title
Book Title
Edition
Volume
128
Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
Item Access Status
Note
Access the data
Related item(s)
Subject
Electrical engineering
Mechanical engineering
Persistent link to this record
Citation
Wu, J; Jin, Z; Liu, A; Yu, L; Yang, F, A hybrid deep-Q-network and model predictive control for point stabilization of visual servoing systems, Control Engineering Practice, 2022, 128, pp. 105314