Do you trust derivatives or differences? (English) Zbl 1352.65668
Summary: We analyze the relationship between the noise level of a function and the accuracy and reliability of derivatives and difference estimates. We derive and empirically validate measures of quality for both derivatives and difference estimates. Using these measures, we quantify the accuracy of derivatives and differences in terms of the noise level of the function. An interesting observation based on these results is that the derivative of a function is not likely to have working precision accuracy for functions with modest levels of noise.
MSC:
| 65Y04 | Numerical algorithms for computer arithmetic, etc. |
Keywords:
computational noise; numerical differentiation; automatic differentiation; iterative solversReferences:
| [1] | Moré, J. J.; Wild, S. M., Estimating computational noise, SIAM J. Sci. Comput., 33, 1292-1314 (2011) · Zbl 1243.65016 |
| [2] | Rump, S. M., INTLAB - INTerval LABoratory, (Csendes, T., Developments in Reliable Computing (1999), Kluwer Academic Publishers: Kluwer Academic Publishers Dordrecht), 77-104 · Zbl 0949.65046 |
| [3] | Bischof, C. H.; Bücker, H. M.; Lang, B.; Rasch, A.; Vehreschild, A., Combining source transformation and operator overloading techniques to compute derivatives for MATLAB programs, (Proceedings of the Second IEEE International Workshop on Source Code Analysis and Manipulation. Proceedings of the Second IEEE International Workshop on Source Code Analysis and Manipulation, SCAM 2002 (2002), IEEE Computer Society: IEEE Computer Society Los Alamitos, CA, USA), 65-72 |
| [4] | Griewank, A.; Walther, A., Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation (2008), SIAM · Zbl 1159.65026 |
| [5] | Griewank, A.; Kulshreshtha, K.; Walther, A., On the numerical stability of algorithmic differentiation, Computing, 94, 125-149 (2012) · Zbl 1238.65013 |
| [6] | Saad, Y., Iterative Methods for Sparse Linear Systems (2003), SIAM · Zbl 1002.65042 |
| [7] | van der Vorst, H. A., Iterative Krylov Methods for Large Linear Systems (2003), Cambridge University Press · Zbl 1023.65027 |
| [8] | Moré, J. J.; Wild, S. M., Do you trust derivatives or differences?: Additional results (2013), See |
| [9] | Moré, J. J.; Wild, S. M., Estimating derivatives of noisy simulations, ACM Trans. Math. Softw., 38, 19:1-19:21 (2012) · Zbl 1365.65056 |
| [10] | Davis, T. A.; Hu, Y., The University of Florida sparse matrix collection, ACM Trans. Math. Softw., 38, 1:1-1:25 (2011) · Zbl 1365.65123 |
| [11] | Choi, S.-C. T.; Paige, C. C.; Saunders, M. A., MINRES-QLP: a Krylov subspace method for indefinite or singular symmetric systems, SIAM J. Sci. Comput., 33, 1810-1836 (2011) · Zbl 1230.65050 |
| [12] | Ziv, A., Relative distance - an error measure in round-off error analysis, Math. Comput., 39, 563-569 (1982) · Zbl 0533.65021 |
| [13] | Knoll, D.; Keyes, D., Jacobian-free Newton-Krylov methods: a survey of approaches and applications, J. Comput. Phys., 193, 357-397 (2004) · Zbl 1036.65045 |
| [14] | Chisholm, T. T.; Zingg, D. W., A Jacobian-free Newton-Krylov algorithm for compressible turbulent fluid flows, J. Comput. Phys., 228, 3490-3507 (2009) · Zbl 1319.76033 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
