Solving nonlinear filtering problems with correlated noise based on Hermite-Galerkin spectral method. (English) Zbl 1520.93576
Summary: Nonlinear filtering problem has important applications in various fields. One of the core issues in nonlinear filtering is to numerically solve the Duncan-Mortensen-Zakai (DMZ) equation, which is an evolution equation satisfied by the unnormalized conditional density of state process under noisy observations, in a real-time and memoryless manner. When the noise in observations is correlated to the state process, the DMZ equation we need to deal with is a second-order stochastic partial differential equation. In this paper, we will propose an algorithm to solve the DMZ equation in this case, based on Hermite-Galerkin spectral method. According to this method, the DMZ equation is converted into a system of linear stochastic differential equations generated by the observation process. The effects of different discretization schemes on this stochastic differential system will also be discussed. Moreover, rigorous convergence analysis of the algorithm is given under mild conditions. Numerical results show that the method proposed in this paper can provide an instantaneous and accurate estimation to the state process of the system.
MSC:
| 93E11 | Filtering in stochastic control theory |
| 93C20 | Control/observation systems governed by partial differential equations |
| 60H15 | Stochastic partial differential equations (aspects of stochastic analysis) |
| 65M60 | Finite element, Rayleigh-Ritz and Galerkin methods for initial value and initial-boundary value problems involving PDEs |
| 65M70 | Spectral, collocation and related methods for initial value and initial-boundary value problems involving PDEs |
Keywords:
nonlinear filtering (NLF); Hermite-Galerkin spectral method (HGSM); correlated noise; stochastic partial differential equation (SPDE); convergence analysisReferences:
| [1] | Ahmed, N. U.; Radaideh, S. M., A powerful numerical technique solving Zakai equation for nonlinear filtering, Dynamics and Control, 7, 293-308 (1997) · Zbl 0880.93052 |
| [2] | Armstrong, J.; King, T., Curved schemes for stochastic differential equations on, or near, manifolds, Proceedings of the Royal Society A, 478 (2022), 20210785 |
| [3] | Arulampalam, M. S.; Maskell, S.; Gordon, N.; Clapp, T., A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking, IEEE Transactions on Signal Processing, 50, 2, 174-188 (2002) |
| [4] | Bain, A.; Crisan, D., Fundamentals of stochastic filtering (2009), Springer-Verlag: Springer-Verlag New York · Zbl 1176.62091 |
| [5] | Baras, J. S.; Blankenship, G. L.; Hopkins, W. E., Existence, uniqueness, and asymptotic behaviour of solutions to a class of Zakai equations with unbounded coefficients, IEEE Transactions on Automatic Control, 28, 2, 203-214 (1983) · Zbl 0535.93063 |
| [6] | Budhiraja, A.; Chen, L.; Lee, C., A survey of numerical methods for nonlinear filtering problems, Physica D, 230, 27-36 (2007) · Zbl 1114.65301 |
| [7] | Ceci, C.; Colaneri, K., Nonlinear filtering for jump diffusion observations, Advances in Applied Probability, 44, 3, 678-701 (2012) · Zbl 1251.93123 |
| [8] | Cheng, M.; Hou, T. Y.; Zhang, Z., A dynamically bi-orthogonal method for time-dependent stochastic partial differential equations: Derivation and algorithms, Journal of Computational Physics, 242, 843-868 (2013) · Zbl 1297.65008 |
| [9] | Davis, M. H.A., On a multiplicative functional transformation arising in nonlinear filtering theory, Zeitschrift FUr Wahrscheinlichkeitstheorie Und Verwandte Gebietë, 54, 125-139 (1980) · Zbl 0431.60043 |
| [10] | Dong, W.; Luo, X.; Yau, S. S.-T., Solving nonlinear filtering problems in real time by Legendre Galerkin spectral method, IEEE Transactions on Automatic Control, 66, 4, 1559-1572 (2021) · Zbl 1536.93914 |
| [11] | Duncan, T. E., Probability densities for diffusion processes with applications to nonlinear filtering theory (1967), Stanford University: Stanford University Stanford, CA, USA, (Ph.D. Dissertation) |
| [12] | Florchinger, P.; Le Gland, F., Time-discretization of the Zakai equation for diffusion processes observed in correlated noise, Stochastics and Stochastics Reports, 35, 233-256 (1991) · Zbl 0729.60036 |
| [13] | Frey, R.; Schmidt, T.; Xu, L., On Galerkin approximations for the Zakai equation with diffusive and point process observations, SIAM Journal on Numerical Analysis, 51, 4, 2036-2062 (2013) · Zbl 1274.60129 |
| [14] | Funaro, D.; Kavian, O., Approximation of some diffusion evolution equations in unbounded domains by Hermite functions, Mathematics of Computation, 57, 196, 597-619 (1991) · Zbl 0764.35007 |
| [15] | Gottlieb, D.; Orszag, S., Numerical analysis of spectral methods: Theory and applications (1977), SIAM-CBMS: SIAM-CBMS Philadelphia · Zbl 0412.65058 |
| [16] | Kloeden, P. E.; Platen, E., Numerical solution of stochastic differential equations (1992), Springer: Springer Berlin, Heidelberg · Zbl 0925.65261 |
| [17] | Liu, J. S.; Chen, R., Sequential Monte Carlo methods for dynamic systems, Journal of the American Statistical Association, 93, 443, 1032-1044 (1998) · Zbl 1064.65500 |
| [18] | Lototsky, S. V., Nonlinear filtering of diffusion processes in correlated noise: Analysis by separation of variables, Applied Mathematics and Optimization, 47, 2, 167-194 (2003) · Zbl 1023.60058 |
| [19] | Lototsky, S.; Mikulevicius, R.; Rozovskii, B. L., Nonlinear filtering revisited: A spectral approach, SIAM Journal on Control and Optimization, 35, 2, 435-461 (1997) · Zbl 0873.60030 |
| [20] | Luo, X.; Yau, S. S.-T., Complete real time solution of the general nonlinear filtering problem without memory, IEEE Transactions on Automatic Control, 58, 10, 2563-2578 (2013) · Zbl 1369.93640 |
| [21] | Luo, X.; Yau, S. S.-T., Hermite spectral method to 1-D forward Kolmogorov equation and its application to nonlinear filtering problems, IEEE Transactions on Automatic Control, 58, 10, 2495-2507 (2013) · Zbl 1369.60046 |
| [22] | Luo, X.; Yau, S. S.-T., Hermite spectral method with hyperbolic cross approximations to high-dimensional parabolic PDEs, SIAM Journal on Numerical Analysis, 51, 6, 3186-3212 (2013) · Zbl 1286.65133 |
| [23] | Mortensen, R. E., Optimal control of continuous time stochastic systems (1996), University of California at Berkeley: University of California at Berkeley CA, USA, (Ph.D. dissertation) |
| [24] | Rozovsky, B. L., Stochastic partial differential equations arising in nonlinear filtering problems, Uspekhi Matematicheskikh Nauk, 27, 213-214 (1972) · Zbl 0258.60033 |
| [25] | Rozovsky, B. L.; Lototsky, S. V., Stochastic evolution systems (2018), Springer: Springer Cham · Zbl 1434.60004 |
| [26] | Shen, J.; Tang, T.; Wang, L.-L., Spectral methods (2011), Springer-Verlag: Springer-Verlag Berlin, Heidelberg · Zbl 1227.65117 |
| [27] | Wang, Z.; Luo, X.; Yau, S. S.-T.; Zhang, Z., Proper orthogonal decomposition method to nonlinear filtering problems in medium-high dimension, IEEE Transactions on Automatic Control, 65, 4, 1613-1624 (2020) · Zbl 1533.93818 |
| [28] | Xiang, X.-M.; Wang, Z. Q., Generalized Hermite spectral method and its applications to problems in unbounded domains, SIAM Journal on Numerical Analysis, 48, 4, 1231-1253 (2010) · Zbl 1219.33010 |
| [29] | Yau, S.-T.; Yau, S. S.-T., Real time solution of nonlinear filtering problem without memory I, Mathematical Research Letters, 7, 671-693 (2000) · Zbl 0967.93089 |
| [30] | Yau, S.-T.; Yau, S. S.-T., Real time solution of the nonlinear filtering problem without memory II, SIAM Journal on Control and Optimization, 47, 1, 163-195 (2008) · Zbl 1172.35411 |
| [31] | Zakai, M., On the optimal filtering of diffusion processes, Zeitschrift FUr Wahrscheinlichkeitstheorie Und Verwandte Gebietë, 11, 3, 230-243 (1969) · Zbl 0164.19201 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
