Improvement Performances of the SMO Observer for PMSM Sensorless Control Based on DTC Strategy Using Simulated Annealing and Reinforcement Learning TD3 Agent
DOI:
https://doi.org/10.52846/stccj.2023.3.2.57Keywords:
PMSM, DTC, Simulated Annealing, SMO, Reinforcement LearningAbstract
From the elements that contribute to increasing the reliability of the control system of a Permanent Magnet Synchronous Motor (PMSM), could be enumerated the replacement of the speed transducers with software-implemented speed observers. On this basis, this paper focuses on the sensorless regulation of a PMSM using a Direct Torque Control (DTC) type strategy, in which a speed observer is used in combination with a Reinforcement Learning-Twin Delayed Deep Deterministic Policy Gradient (RL-TD3) type agent to increase the accuracy of the PMSM rotor speed estimate. Simulated Annealing (SA) is also used to achieve superior performance of the velocity observer for optimal tuning of the PI-type velocity controller parameters. The latter can, after the training phase, provide correction signals to the speed observer so that the estimated speed is as close as possible to the estimated speed. The control structures, control algorithms, and operating equations of the PMSM, the control strategy of the DTC type, and the speed observer are presented in this paper. Numerical simulations carried out in the Matlab/Simulink programming environment validate the superiority of the PMSM rotor speed estimation performance in the case of the use of an RL-TD3-type agent in combination with a speed observer, compared to the case of the use of the speed observer alone.
References
T. H. Nguyen, T. T. Nguyen, K. Minh Le, H. N. Tran, J. W. Jeon, “An Adaptive Backstepping Sliding-Mode Control for Improving Position Tracking of a Permanent-Magnet Synchronous Motor With a Nonlinear Disturbance Observer,” in IEEE Access, vol. 11, pp. 19173-19185, February 2023.
X. Lin et al., “Observer-Based Fixed-Time Control for Permanent- Magnet Synchronous Motors With Parameter Uncertainties,” in IEEE Transactions on Power Electronics, vol. 38, no. 4, pp. 4335-4344, April 2023.
Y. Fan, J. Chen, Q. Zhang, M. Cheng, “An Improved Inertia Disturbance Suppression Method for PMSM Based on Disturbance Observer and Two-Degree-of-Freedom PI Controller,” in IEEE Transactions on Power Electronics, vol. 38, no. 3, pp. 3590-3599, March 2023.
G. H. B. Foo and M. F. Rahman, “Direct Torque Control of an IPMSynchronous Motor Drive at Very Low Speed Using a Sliding-Mode Stator Flux Observer,” in IEEE Transactions on Power Electronics, vol. 25, no. 4, pp. 933-942, April 2010.
Y. Zheng, Z. Cao, Z. Man, A. Kumar, S. Wang, “Phase-lead Repetitive Control of a PMSM with Field-oriented Feedback Linearization and a disturbance observer,” IECON 2021 – 47th Annual Conference of the IEEE Industrial Electronics Society, Toronto, ON, Canada, 2021, pp. 1-4.
M. N. Nicola and C. -I. Nicola, “Improvement Performances of Sensorless Control for PMSM Based on DTC Strategy Using SMO Observer and RL-TD3 Agent,” 5th Global Power, Energy and Communication Conference (GPECOM), Nevsehir, Turkiye, 2023, pp. 131-136.
X. Zhang, X. Xie, R. Yao, “Field oriented control for permanent magnet synchronous motor based on DSP experimental platform," The 27th Chinese Control and Decision Conference (2015 CCDC), Qingdao, China, 2015, pp. 1870-1875.
C. -I. Nicola and M. Nicola, “Real Time Implementation of the PMSM Sensorless Control Based on FOC Strategy,” 4th Global Power, Energy and Communication Conference (GPECOM), Nevsehir, Turkey, 2022, pp. 179-183.
L. Qi, Z. Yong, Z. Chao, W. Man, “Research on rotor field-oriented vector control of PMSM for aircraft electro-mechanical actuator,” Chinese Control and Decision Conference (CCDC), Yinchuan, China, 2016, pp. 6422-6427.
R. G. Iturra and P. Thiemann, “Sensorless Field Oriented Control of PMSM using Direct Flux Control with improved measurement sequence,” XVIII International Scientific Technical Conference Alternating Current Electric Drives (ACED), Ekaterinburg, Russia, 2021, pp. 1-6.
K. V. P. Kumar and T. V. Kumar, “Improvised direct torque control strategies of open end winding PMSM fed with multi-level inversion,” IEEE International Conference on Industrial Technology (ICIT), Lyon, France, 2018, pp. 425-430.
M. Nicola, C. -I. Nicola, D. Sacerdoţianu, “Sensorless Control of PMSM using DTC Strategy Based on PI-ILC Law and MRAS Observer,” International Conference on Development and Application Systems (DAS), Suceava, Romania, 2020, pp. 38-43.
W. Wu, F. Xie, G. Li, K. Liang, C. Qiu, H. Jiang, “Research on Direct Torque Control Based on RZVSVPWM of PMSM,” 14th IEEE Conference on Industrial Electronics and Applications (ICIEA), Xi'an, China, 2019, pp. 2507-2511.
A. Vujji and R. Dahiya, “Design of PI Controller for Space Vector Modulation based Direct Flux and Torque Control of PMSM Drive,” First IEEE International Conference on Measurement, Instrumentation, Control and Automation (ICMICA), Kurukshetra, India, 2020, pp. 1-6.
M. Nicola and C. -I. Nicola, “Sensorless Control for PMSM Using Model Reference Adaptive Control and back-EMF Sliding Mode Observer,” International Conference on Electromechanical and Energy Systems (SIELMEN), Craiova, Romania, 2019, pp. 1-7.
I. Tangirala, T. Ramesh, P. D. Kumar, R. Pothuraju, “Sensorless control of Five level inverter fed Fuzzy Logic based DTFC SVM Controlled PMSM drive using Luenberger Observer,” IEEE IAS Global Conference on Emerging Technologies (GlobConET), Arad, Romania, 2022, pp. 852-857.
S. S. Badini and V. Verma, “A Novel MRAS Based Speed Sensorless Vector Controlled PMSM Drive,” 54th International Universities Power Engineering Conference (UPEC), Bucharest, Romania, 2019, pp. 1-6.
H. Li and Z. Wang, “Sensorless Control for PMSM Drives Using the Cubature Kalman Filter based Speed and Flux Observer,” IEEE International Conference on Electrical Systems for Aircraft, Railway, Ship Propulsion and Road Vehicles & International Transportation Electrification Conference (ESARS-ITEC), Nottingham, UK, 2018, pp. 1-6.
G. Yi, W. Zhou, S. Li, Y. Chen, “Access Craft Scheduling of Stereo Garage Based on Improved Hybrid Simulated Annealing Algorithm,” 4th International Conference on Robotics, Control and Automation Engineering (RCAE), Wuhan, China, 2021, pp. 423-427.
B. Aylaj and S. Nouh, “Degeneration vs Classical of simulated annealing algorithm: performance analysis,” 5th International Conference on Advanced Communication Technologies and Networking (CommNet), Marrakech, Morocco, 2022, pp. 1-5.
M. Nicola and C. -I. Nicola, “Improvement of PMSM Control Using Reinforcement Learning Deep Deterministic Policy Gradient Agent,” 21st International Symposium on Power Electronics (Ee), Novi Sad, Serbia, 2021, pp. 1-6.
Reinforcement Learning Toolbox™ User's Guide, Matlab and Simulink, MathWorks, Natick, MA, USA, 2020.
P. Brandimarte, From Shortest Paths to Reinforcement Learning: A MATLAB-Based Tutorial on Dynamic Programming, Springer Nature, 2021.
R. S. Sutton and A. G. Barto, Reinforcement Learning An Introduction, second edition, The MIT Press, London, England, 2018.
Downloads
Published
Issue
Section
How to Cite
Accepted 2023-12-28
Published 2023-12-31
