×

Randomized algorithms for robust controller synthesis using statistical learning theory: a tutorial overview. (English) Zbl 1293.93321

Summary: By now it is well known that several problems in the robustness analysis and synthesis of control systems are NP-complete or NP-hard. These negative results force us to modify our notion of “solving” a given problem. If we cannot solve a problem exactly because it is NP-hard, then we must settle for solving it approximately. If we cannot solve all instances of a problem, we must settle for solving “almost all” instances of a problem. An approach that is recently gaining popularity is that of using randomized algorithms. The notion of a randomized algorithm as defined here is somewhat different from that in the computer science literature, and enlarges the class of problems that can be efficiently solved. We begin with the premise that many problems in robustness analysis and synthesis can be formulated as the minimization of an objective function with respect to the controller parameters. It is argued that, in order to assess the performance of a controller as the plant varies over a prespecified family, it is better to use the average performance of the controller as the objective function to be minimized, rather than its worst-case performance, as the worstcase objective function usually leads to rather conservative designs. Then it is shown that a property from statistical learning theory known as uniform convergence of empirical means (UCEM) plays an important role in allowing us to construct efficient randomized algorithms for a wide variety of controller synthesis problems. In particular, whenever the UCEM property holds, there exists an efficient (i.e., polynomial-time) randomized algorithm. Using very recent results in statistical learning theory, it is shown that the UCEM property holds in several problems such as robust stabilization and weighted \(H_2/H_\infty\)-norm minimization. Hence it is possible to solve such problems efficiently using randomized algorithms.

MSC:

93B50 Synthesis problems
93E25 Computational methods in stochastic control (MSC2010)
93B35 Sensitivity (robustness)
93E35 Stochastic learning and adaptive control
Full Text: DOI

References:

[1] Braatz, R.; Young, P.; Doyle, J.; Morari, M., Computational complexity of the μ calculation, IEEE Trans Auto Control, 39, 1000-1002 (1994) · Zbl 0807.93020
[2] Blondel, V.; Tsitsiklis, J. N., NP-hardness of some linear control design problems, SIAM J Control Opt, 35, 6, 2118-2127 (1997) · Zbl 0892.93050
[3] Blondel, V.; Tsitsiklis, J. N., A survey of computational complexity results in systems and control, Automatica, 45, 9, 1249-1274 (2000) · Zbl 0989.93006
[4] Coxson, G. E.; DeMarco, C., The computational complexity of approximating the minimal perturbation scaling to achieve instability in an interval matrix, Math Control, Signals Systems, 7, 279-291 (1994) · Zbl 0840.93073
[5] Doyle, J., Analysis of feedback systems with structured uncertainties, Proc IEEE, 129, 242-250 (1982)
[6] Fine, T. L., Feedforward neural network methodology (1999), Springer-Verlag: Springer-Verlag New York · Zbl 0963.68163
[7] Gantmacher, F. R., Matrix theory vol II (1959), Chelsea: Chelsea New York · Zbl 0085.01001
[8] Garey, M. R.; Johnson, D. S., Computers and intractability: a guide to the theory of NP-completeness (1979), W.H. Freeman: W.H. Freeman New York · Zbl 0411.68039
[9] Haussler, D., Decision theoretic generalizations of the PAC model for neural net and other learning applications, Information and Computation, 100, 78-150 (1992) · Zbl 0762.68050
[10] Hoeffding, W., Probability inequalities for sums of bounded random variables, J Amer Statist Assoc, 58, 13-30 (1993) · Zbl 0127.10602
[11] Jury, E. I., Inners and stability of dynamical systems (1977), John Wiley: John Wiley New York
[12] Kailath, T., Linear systems (1979), Prentice-Hall: Prentice-Hall Englewood Cliffs, NJ, USA · Zbl 0428.93024
[13] Karpinski, M.; Macintyre, A. J., Polynomial bounds for VC dimension of sigmoidal neural networks, (Proc 27th ACM Symp Thy. Computing (1995)), 200-208 · Zbl 0978.68562
[14] Karpinski, M.; Macintyre, A. J., Polynomial bounds for VC dimension of sigmoidal and general Pfaffian neural networks, J Comp Sys Sci, 54, 169-176 (1997) · Zbl 0869.68088
[15] Khargonekar, P. P.; Tikku, A., Randomized algorithms for robust control analysis have polynomial complexity, (Proc Conf Decision Control (1996)) · Zbl 0923.93045
[16] Kowalczyk, A.; Ferra, H.; Szymanski, J., Combining statistical physics with VC-bounds on generalisation in learning systems, (Proc Sixth Australian Conf Neural Networks (ACNN’95). Proc Sixth Australian Conf Neural Networks (ACNN’95), Sydney (1995)), 41-44
[17] Macintyre, A. J.; Sontag, E. D., Finiteness results for sigmoidal neural networks, (Proc 25th ACM Symp. Thy of Computing (1993)), 325-334 · Zbl 1310.68077
[18] Marrison, C.; Stengel, R., The use of random search and genetic algorithms to optimize stochastic robustness functions, (Proc Amer Control Conf Baltimore, MD (1994)), 1484-1489
[19] Massart, P., The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality, Ann Prob, 18, 3, 1269-1283 (1990) · Zbl 0713.62021
[20] Motwani, R.; Raghavan, P., Randomized algorithms (1995), Cambridge University Press: Cambridge University Press Cambridge · Zbl 0849.68039
[21] Nemirovskii, A., Several NP-hard problems arising in robust stability analysis, Math Control, Signals, and Systems, 6, 2, 99-105 (1993) · Zbl 0792.93100
[22] Newton, G. C.; Gould, L. A.; Kaiser, J. F., Analytic design of linear feedback controls (1967), John Wiley: John Wiley New York
[23] Papadimitrou, C., Computational complexity (1994), Addison-Wesley, Reading, MA: Addison-Wesley, Reading, MA USA · Zbl 0833.68049
[24] Patel, V. V.; Deodhare, G. S.; Viswanath, T., Some applications of randomized algorithms for control system design, Submitted to Automatica (2000) · Zbl 1019.93021
[25] Parrondo, J. M.; van den Broeck, C., Vapnik-Chervonenkis bounds for generalization, J Phys A, 26, 2211-2223 (1993) · Zbl 0777.60098
[26] Poljak, S.; Rohn, J., Checking robust nonsingularity is NP-hard, Math Control Signals, and Systems, 6, 1, 1-9 (1993) · Zbl 0780.93027
[27] Ray, L. R.; Stengel, R. F., Stochastic robustness of linear time-invariant control systems, IEEE Trans Auto Control, 36, 82-87 (1991) · Zbl 0722.93017
[28] Steele, J. M., Empirical discrepancies and subadditive processes, Ann Prob, 6, 118-127 (1978) · Zbl 0374.60037
[29] Tempo, R. E.; Bai, W.; Dabbene, F., Probabilistic robustness analysis: Explicit bounds for the minimum number of sampling points, Systems & Control Letters, 30, 237-242 (1997) · Zbl 0901.93017
[30] Vapnik, V. N., Estimation of dependences based on empirical data (1982), Springer-Verlag · Zbl 0499.62005
[31] Vapnik, V. N., Statistical learning theory (1998), John Wiley: John Wiley New York · Zbl 0935.62007
[32] Vapnik, V. N.; Chervonenkis, A. Ya., On the uniform convergence of relative frequencies to their probabilities, Theory Prob its Appl, 16, 2, 264-280 (1971) · Zbl 0247.60005
[33] Vapnik, V. N.; Chervonenkis AYa., Necessary and sufficient conditions for the uniform convergence of means to their expectations, Theory Prob its Appl, 26, 3, 532-553 (1981) · Zbl 0487.60036
[34] Vidyasagar, M., A theory of learning and generalization: with applications to neural networks and control systems (1997), Springer-Verlag: Springer-Verlag London · Zbl 0928.68061
[35] Vidyasagar, M., Statistical learning theory and its applications to randomized algorithms for robust controller synthesis, (Basten, G.; Gevers, M., Semi-Plenary Lecture, European Control Conference. Semi-Plenary Lecture, European Control Conference, Brussels, Belgium (1997)), 161-189
[36] Vidyasagar M. Randomized algorithms for robust controller synthesis using statistical learning theory. Automatica (to appear); Vidyasagar M. Randomized algorithms for robust controller synthesis using statistical learning theory. Automatica (to appear) · Zbl 0923.93051
[37] Vidyasagar M, Blondel V. Probabilistic solutions to some NP-hard matrix problems. Automatica (to appear); Vidyasagar M, Blondel V. Probabilistic solutions to some NP-hard matrix problems. Automatica (to appear) · Zbl 1031.93165
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.