Volume 17, Issue 2 (Journal of Control, V.17, N.2 Summer 2023)
JoC 2023, 17(2): 47-79 |
Back to browse issues page
Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Lotfi M, Menhaj M B. An overview of intelligent systems (neural networks) from the perspective of classical theory and their application in modeling and control of complex systems. JoC 2023; 17 (2) :47-79
URL: http://joc.kntu.ac.ir/article-1-1010-en.html
URL: http://joc.kntu.ac.ir/article-1-1010-en.html
1- Amirkabir University of Technology (Tehran Polytechnique)
Abstract: (935 Views)
In recent years, with the advancement of industry and technology, we see that systems are becoming more and more complex. This complexity in the industry has required a parallel progress in control systems (controllers), which has multiplied the need for advanced and intelligen t controllers. One of the most important criteria in the design of any control system is the accurate knowledge of the system or, more precisely, the modeling of the system. Considering these two challenges, this paper examines intelligent systems and specifically neural networks from the perspective of classical theory and their application in modeling and control of complex systems. At first, the basic element of neural networks, i.e. neuron, is introduced and its types of models (collective and radial) are also presented. Then the types of neural networks such as multilayer perceptron neural networks (MLP-NN), radial basis neural networks (RBF-NN) and recurrent neural networks (RNN) are described and the appropriate number of layers and also the appropriate number of neurons in the hidden layers in neural networks for different applications and especially for the approximation of nonlinear functions (modeling) are discussed. Then, it is tried to build a bridge between the concepts of neural networks (intelligent world) and the concepts of classical world and analyze neural networks from the perspective of classical theory. It is shown that from the point of view of classical theory, a neural network can be considered as a model structure and its weights and biases as unknown parameters of this structure. In neural networks, learning algorithms are used to determine the unknown parameters of the network (weights and biases). Therefore, learning algorithms of neural networks are studied from the point of view of classical theory and specifically in relation to numerical optimization and a bridge will be built between learning algorithms and numerical optimization methods. Also, the most important neural network learning algorithms are introduced along with their advantages and disadvantages. In the end, two important applications of neural networks, modeling and control, are discussed and for each of these applications, several illustrative examples are presented and simulated to show the effectiveness of neural networks.
Type of Article: Research paper |
Subject:
New approaches in control engineering
Received: 2023/07/28 | Accepted: 2023/09/17 | ePublished ahead of print: 2023/09/21 | Published: 2023/09/21
Received: 2023/07/28 | Accepted: 2023/09/17 | ePublished ahead of print: 2023/09/21 | Published: 2023/09/21
References
1. محمدباقر منهاج، هدی نخبه الفقهایی، "تحلیل و کنترل سیستم های دینامیکی و چند متغیره خطی"، جلد اول، انتشارات دانشگاه صنعتی امیرکبیر، 1401.
2. محمدباقر منهاج، هدی نخبه الفقهایی، "تحلیل و کنترل سیستم های دینامیکی و چند متغیره خطی"، جلد دوم، پیش‌انتشار.
3. . محمدباقرمنهاج، محمد لطفی، "سیستم‌های دینامیکی هایبرید، جلد اول، پیش‌انتشار.
4. . محمدباقر منهاج، "سیستم‌های کنترل تطبیقی"، انتشارات نهر دانش، 1395
5. محمدباقرمنهاج، "مبانی شبکه‌های عصبی"، انتشارات دانشگاه صنعتی امیرکبیر، 1397.
6. محمدباقر منهاج، "محاسبات فازی"، انتشارات دانش نگار، 1394.
7. .محمدباقر منهاج، یاسر شکری کلاندرق، "کنترل فازی"، انتشارات نهر دانش، 1394.
8. [8]. F. P. Brooks, "What's real about virtual reality?," in IEEE Computer Graphics and Applications, vol. 19, no. 6, pp. 16-27, Nov.-Dec. 1999, doi: 10.1109/38.799723. [DOI:10.1109/38.799723]
9. [9]. Xue, Dingyü, YangQuan Chen, and Derek P. Atherton. Linear feedback control: analysis and design with MATLAB. Society for Industrial and Applied Mathematics, 2007. [DOI:10.1137/1.9780898718621]
10. [10]. Mayr, Otto. "The origins of feedback control." Scientific American 223.4, 110-119, 1970. [DOI:10.1038/scientificamerican1070-110]
11. [11]. Minorsky, Nicolas. "Directional stability of automatically steered bodies." Journal of the American Society for Naval Engineers 34.2, 280-309, 1922. [DOI:10.1111/j.1559-3584.1922.tb04958.x]
12. [12]. Ziegler, John G., and Nathaniel B. Nichols. "Optimum settings for automatic controllers." Transactions of the American society of mechanical engineers 64.8, 759-765, 1942. [DOI:10.1115/1.4019264]
13. [13]. Nyquist, Harry. "Regeneration theory." Bell system technical journal 11.1, 126-147, 1932. [DOI:10.1002/j.1538-7305.1932.tb02344.x]
14. [14]. Bode, Hendrik W. "Network analysis and feedback amplifier design.", Princeton, NJ:Van Nostrand, 1945.
15. [15]. James, Hubert Maxwell, et al., eds. Theory of servomechanisms. Vol. 25. New York: McGraw-Hill, 1947.
16. [16]. Evans, Walter R. "Graphical analysis of control systems." Transactions of the American Institute of Electrical Engineers 67.1, 547-551, 1948. [DOI:10.1109/T-AIEE.1948.5059708]
17. [17]. Pontryagin, L. S., Boltyanskii, V. G., Gamkrelidze, R. V., & Mishchenko, E. F., "The mathematical theory of optimal processes", Wiley. New York, 1962.
18. [18]. Bellman, Richard. "Dynamic programming" Science 153.3731, 34-37, 1966. [DOI:10.1126/science.153.3731.34]
19. [19]. Kalman, Rudolf E. "On the general theory of control systems." Proceedings First International Conference on Automatic Control, Moscow, USSR, 1960. [DOI:10.1016/S1474-6670(17)70094-8]
20. [20]. Kalman, Rudolf Emil. "Mathematical description of linear dynamical systems." Journal of the Society for Industrial and Applied Mathematics, Series A: Control 1.2, 152-192, 1963. [DOI:10.1137/0301010]
21. [21]. Kalman, Rudolf Emil. "When is a linear control system optimal?.", Transactions of ASME Journal of Basic Engineering Series D, 51-60, 1964. [DOI:10.1115/1.3653115]
22. [22]. Doyle, John, and Gunter Stein. "Robustness with observers." IEEE transactions on automatic control 24.4, 607-611, 1979. [DOI:10.1109/TAC.1979.1102095]
23. [23]. Bryson, Arthur Earl. Applied optimal control: optimization, estimation and control. Routledge, 2018. [DOI:10.1201/9781315137667]
24. [24]. Berkovitz, Leonard David. Optimal control theory. Vol. 12. Springer Science & Business Media, 2013. [DOI:10.1201/b12739]
25. [25]. Hocking, Leslie M. Optimal control: an introduction to the theory with applications. Oxford University Press, 1991. [DOI:10.1093/oso/9780198596752.001.0001]
26. [26]. Krstic, Miroslav, and Hua Deng. Stabilization of nonlinear uncertain systems. London: Springer, 1998.
27. [27]. Gajic, Zoran. Optimal control of singularly perturbed linear systems and applications. CRC Press, 2001. [DOI:10.1201/9780203907900]
28. [28]. Trentelman, Harry L., Anton A. Stoorvogel, and Malo Hautus. Control theory for linear systems. Springer Science & Business Media, 2001. [DOI:10.1007/978-1-4471-0339-4]
29. [29]. Naidu, Desineni Subbaram. "optimal control systems.", CRC press, 2002.
30. [30]. Chen, Wen-Hua, Donald J. Ballance, and Peter J. Gawthrop. "Optimal control of nonlinear systems: a predictive control approach." Automatica 39.4 (2003): 633-641. [DOI:10.1016/S0005-1098(02)00272-8]
31. [31]. Kirk, Donald E. Optimal control theory: an introduction. Courier Corporation, 2004.
32. [32]. Athans, Michael, and Peter L. Falb. Optimal control: an introduction to the theory and its applications. Dover publication, 2006.
33. [33]. Lewis, Frank L., Lihua Xie, and Dan Popa. Optimal and robust estimation: with an introduction to stochastic control theory. CRC press, 2007.
34. [34]. Sinha, Alok. Linear systems: optimal and robust control. CRC press, 2007. [DOI:10.1201/9781420008883]
35. [35]. Bhattacharyya, Shankar P., Aniruddha Datta, and Lee H. Keel. Linear control theory: structure, robustness, and optimization. CRC press, 2009.
36. [36]. Speyer, Jason L., and David H. Jacobson. Primer on optimal control theory. Society for Industrial and Applied Mathematics, 2010. [DOI:10.1137/1.9780898718560]
37. [37]. Berkovitz, Leonard David, and Negash G. Medhin. Nonlinear optimal control theory. CRC press, 2012. [DOI:10.1201/b12739]
38. [38]. Lewis, Frank L., Draguna Vrabie, and Vassilis L. Syrmos. Optimal control. John Wiley & Sons, 2012. [DOI:10.1002/9781118122631]
39. [39]. Sussmann, Hector J. Nonlinear controllability and optimal control. Routledge, 2017. [DOI:10.1201/9780203745625]
40. [40]. Kolosov, Gennadii E. Optimal Design of Control Systems: Stochastic and Deterministic Problems (Pure and Applied Mathematics: A Series of Monographs and Textbooks/221), 3rd Edition, CRC Press, 1999.
41. [41]. Fortuna, Luigi, Mattia Frasca, and Arturo Buscarino. Optimal and Robust Control: Advanced Topics with MATLAB®. CRC press, 2021. [DOI:10.1201/9781003196921]
42. [42]. Jadamba, Baasansuren, et al., eds. Deterministic and Stochastic Optimal Control and Inverse Problems. CRC Press, 2021. [DOI:10.1201/9781003050575]
43. [43]. Thyagarajan, T., and D. Kalpana. Linear and Non-Linear System Theory. CRC Press, 2020. [DOI:10.1201/9780429323454]
44. [44]. Hernández-Lerma, Onésimo, et al. An introduction to optimal control theory: The dynamic programming approach. Springer, 2023. [DOI:10.1007/978-3-031-21139-3]
45. [45]. G. Johnson, "A deterministic theory of estimation and control," in IEEE Transactions on Automatic Control, vol. 14, no. 4, pp. 380-384, 1969, doi: 10.1109/TAC.1969.1099191. [DOI:10.1109/TAC.1969.1099191]
46. [46]. Isermann, Rolf, and Rolf Isermann. "Stochastic Control Systems (Introduction)." Digital Control Systems: Volume 2: Stochastic Control, Multivariable Control, Adaptive Control, Applications (1991): 3-9. [DOI:10.1007/978-3-642-86420-9_1]
47. [47]. Chen, Goong, Guanrong Chen, and Shih-Hsun Hsu. Linear stochastic control systems. Vol. 3. CRC press, 1995.
48. [48]. Krstic, Miroslav, and Hua Deng. Stabilization of nonlinear uncertain systems. London: Springer, 1998.
49. [49]. Deng, Hua, Miroslav Krstic, and Ruth J. Williams. "Stabilization of stochastic nonlinear systems driven by noise of unknown covariance." IEEE Transactions on automatic control 46.8 (2001): 1237-1253. [DOI:10.1109/9.940927]
50. [50]. Åström, Karl J. Introduction to stochastic control theory. Dover Publications, 2006.
51. [51]. Kouvaritakis, Basil, and Mark Cannon. "Model predictive control." Switzerland: Springer International Publishing 38 (2016). [DOI:10.1007/978-3-319-24853-0]
52. [52]. Zhang, Weihai, Lihua Xie, and Bor-Sen Chen. Stochastic H2/H∞ control: A Nash game approach. CRC Press, 2017.
53. [53]. Pinsky, Mark A. Stochastic analysis and applications. CRC Press, 2019. [DOI:10.1201/9781003064923]
54. [54]. Buckdahn, Rainer, Hans J. Engelbert, and Marc Yor, eds. Stochastic Processes and Related Topics: Proceedings of the 12th Winter School, Siegmundsburg (Germany), February 27-March 4, 2000. Vol. 12. CRC Press, 2002. [DOI:10.1201/9781482265231]
55. [55]. Wei, Guoliang, Zidong Wang, and Wei Qian. Nonlinear Stochastic Control and Filtering with Engineering-oriented Complexities. CRC Press, 2016. [DOI:10.1201/9781315367651]
56. [56]. Kulkarni, Vidyadhar G. Modeling and analysis of stochastic systems. Crc Press, 2016. [DOI:10.1201/9781315367910]
57. [57]. Jadamba, Baasansuren, et al., eds. Deterministic and Stochastic Optimal Control and Inverse Problems. CRC Press, 2021. [DOI:10.1201/9781003050575]
58. [58]. Zames, George. "Feedback and optimal sensitivity: Model reference transformations, multiplicative seminorms, and approximate inverses." IEEE Transactions on automatic control 26.2 (1981): 301-320. [DOI:10.1109/TAC.1981.1102603]
59. [59]. Bhattacharyya, Shankar P., and Lee H. Keel, eds. Control of uncertain dynamic systems. Vol. 230. Boca Raton, FL: CRC Press, 1991.
60. [60]. Wang, Youyi, Lihua Xie, and Carlos E. De Souza. "Robust control of a class of uncertain nonlinear systems." Systems & control letters 19.2 (1992): 139-149. [DOI:10.1016/0167-6911(92)90097-C]
61. [61]. C Edwards and S Spurgeon, " Sliding Mode Control Theory And Applications", CRC Press, 1998. [DOI:10.1201/9781498701822]
62. [62]. Bechlioulis, Charalampos P., and George A. Rovithakis. "Robust adaptive control of feedback linearizable MIMO nonlinear systems with prescribed performance." IEEE Transactions on Automatic Control 53.9 (2008): 2090-2099. [DOI:10.1109/TAC.2008.929402]
63. [63]. Safonov, Michael George. "Robust control, stability margin." Encyclopedia of Optimization 5 (1999): 44-49.
64. [64]. Wen, Changyun, et al. "Robust adaptive control of uncertain nonlinear systems in the presence of input saturation and external disturbance." IEEE Transactions on Automatic Control 56.7 (2011): 1672-1678. [DOI:10.1109/TAC.2011.2122730]
65. [65]. Duan, Guang-Ren, and Hai-Hua Yu. LMIs in control systems: analysis, design and applications. CRC press, 2013. [DOI:10.1201/b15060]
66. [66]. Liu, Tengfei, Zhong-Ping Jiang, and David J. Hill. Nonlinear control of dynamic networks. CRC Press, 2018. [DOI:10.1201/b16759]
67. [67]. Raol, Jitendra R., and Ramakalyan Ayyagari. "Control systems: classical, modern, and AI-based approaches". CRC Press, 2019. [DOI:10.1201/9781351170802]
68. [68]. Tsui, Chia-Chi. Robust control system design: advanced state space techniques. CRC Press, 2022. [DOI:10.1201/9781003259572]
69. [69]. Marino, R. I. C. C. A. R. D. O., and P. A. T. R. I. Z. I. O. Tomei. "Global adaptive output-feedback control of nonlinear systems." Proceedings of the 30th IEEE Conference on Decision and Control. IEEE, 1991.
70. [70]. Khalil, Hassan K. "Adaptive output feedback control of nonlinear systems represented by input-output models." IEEE transactions on Automatic Control 41.2 (1996): 177-188. [DOI:10.1109/9.481517]
71. [71]. Astolfi, Alessandro, Dimitrios Karagiannis, and Romeo Ortega. Nonlinear and adaptive control with applications. Vol. 187. London: Springer, 2008. [DOI:10.1007/978-1-84800-066-7]
72. [72]. Yang, Guang-Hong, and Dan Ye. Reliable control and filtering of linear systems with adaptive mechanisms. CRC Press, 2010. [DOI:10.1201/EBK1439835227]
73. [73]. Chen, Mou, Shuzhi Sam Ge, and Beibei Ren. "Adaptive tracking control of uncertain MIMO nonlinear systems with input constraints." Automatica 47.3 (2011): 452-465. [DOI:10.1016/j.automatica.2011.01.025]
74. [74]. Bellman, Richard, and Robert Kalaba, eds. Classic Papers in Control Theory. Courier Dover Publications, 2017.
75. [75]. Chalam, V. V. Adaptive control systems: Techniques and applications. Marcel Dekker, Inc., 2017. [DOI:10.1201/9781315136646]
76. [76]. Song, Yong-Duan. Control of nonlinear systems via PI, PD and PID: Stability and performance. CRC Press, 2018. [DOI:10.1201/9780429455070]
77. [77]. https://faradars.org/
78. ]78[. محمد فتحی، فرینا زمانی اسکویی، تئوری و کاربرد شبکه‌های عصبی در MATLAB، انتشارات کانون نشر علوم، چاپ اول، 1397.
79. ]79[. سید مصطفی کیا، شبکه‌های عصبی در MATLAB، انتشارات نشر دانشگاهی کیا، چاپ پنجم، 1395.
80. [80].Feldman, Jerome A., and Dana H. Ballard. "Connectionist models and their properties." Cognitive science 6.3 (1982): 205-254. [DOI:10.1016/S0364-0213(82)80001-3]
81. [81]. J. Heaton, "Introduction to Neural Networks for Java", 2nd Edition, Heaton Research, Inc., 2008.
82. [82]. J. Nocedal and S. J. Wright, "Numerical Optimization", 2Nd Edition, Springer-Verlag New York, 2006.
83. [83]. A. Papoulis, "Probability & Statistics", Prentice Hall, 1990.
84. [84]. Sistu, Phani B., and B. Wayne Bequette. "Nonlinear predictive control of uncertain processes: Application to a CSTR." AIChE Journal 37.11 (1991): 1711-1723. [DOI:10.1002/aic.690371114]
85. [85]. Narendra, Kumpati S. and Kannan Parthasarathy, "Learning Automata Approach to Hierarchical Multiobjective Analysis," IEEE Transactions on Systems, Man and Cybernetics, Vol. 20, No. 1, January/February 1991, pp. 263-272. [DOI:10.1109/21.101158]
86. [86]. Hagan, M.T., O. De Jesus, and R. Schultz, "Training Recurrent Networks for Filtering and Control," Chapter 12 in Recurrent Neural Networks: Design and Applications, L. Medsker and L.C. Jain, Eds., CRC Press, pp. 311-340.
87. [87]. Narendra, K.S., and S. Mukhopadhyay, "Adaptive Control Using Neural Networks and Approximate Models," IEEE Transactions on Neural Networks, Vol. 8, 1997, pp. 475-485. [DOI:10.1109/72.572089]
Send email to the article author
| Rights and permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
