In this textbook, the author presents the theory and methods of adaptive control of stochastic processes. The textbook is written for the students of institutes of civil aviation.
In Chapter one, the elements of the theory of stochastic processes are presented: Markov and Poisson processes, martingales and processes with independent increments. Chapter two is devoted to controllable Markov processes, and their application to the problem of sampling with and without rejection Markov processes with profits and a recurrent form for the profits is also considered. Chapter three deals with the optimal stopping problem. Sequential decision and experimental design algorithms are considered in Chapter four. Chapter five is devoted to the problem of stability of a method of smoothing in control systems with digital computers.