×

Fourier trajectory analysis for system discrimination. (English) Zbl 1487.90223

Summary: With few exceptions, simulation output analysis has focused on static characterizations, to determine a property of the steady-state distribution of a performance metric such as a mean, a quantile, or the distribution itself. Analyses often seek to overcome difficulties induced by autocorrelation of the output stream. But sample paths generated by stochastic simulation exhibit dynamic behaviour that is characteristic of system structure and associated distributions. In this paper, we explore these dynamic characteristics, as captured by the Fourier transform of a dynamic steady-state simulation trajectory. We find that Fourier coefficient magnitudes can have greater discriminatory power than the usual test statistics when two systems have different utilisations and/or dynamic behaviour, and with simpler analysis resulting from the statistical independence of coefficient estimates at different frequencies.

MSC:

90B22 Queues and service in operations research
60K25 Queueing theory (aspects of probability theory)

Software:

ASAP3; VBASim
Full Text: DOI

References:

[1] Bartlett, M. S., Periodogram analysis and continuous spectra, Biometrika, 37, 1/2, 1-16 (1950) · Zbl 0036.21701
[2] Bonferroni, C. E., Teoria statistica delle classi e calcolo delle probabilit (1936), Libreria Internazionale Seeber · Zbl 0016.41103
[3] Chui, C. K., Wavelets: A mathematical tool for signal analysis, Mathematical modeling and computation (1997), Society for Industrial and Applied Mathematics: Society for Industrial and Applied Mathematics Philadelphia · Zbl 0903.94007
[4] Cooley, J. W.; Tukey, J. W., An algorithm for the machine calculation of complex Fourier series, Mathematics of Computation, 19, 90, 297-301 (1965) · Zbl 0127.09002
[5] Dong, J.; Whitt, W., Stochastic grey-box modeling of queueing systems: Fitting birth-and-death processes to data, Queueing Systems: Theory and Applications, 79, 3-4, 391-426 (2015) · Zbl 1317.60119
[6] Eick, S. G.; Massey, W. A.; Whitt, W., Mt/G/ queues with sinusoidal arrival rates, Management Science, 39, 2, 241-252 (1993) · Zbl 0773.60086
[7] Epstein, C., How well does the finite Fourier transform approximate the Fourier transform?, Communications on Pure and Applied Mathematics, 58, 1421-1435 (2005) · Zbl 1079.65139
[8] Feller, W., On the Fourier representation for markov chains and the strong ratio theorem, Journal of Mathematics and Mechanics, 15, 2, 273-283 (1966) · Zbl 0133.40806
[9] Fishman, G. S., Estimating sample size in computing simulation experiments, Management Science, 18, 1, 21-38 (1971) · Zbl 0239.62056
[10] Fishman, G. S.; Kiviat, P. J., The analysis of simulation-generated time series, Management Science, 13, 7, 525-557 (1967)
[11] Freedman, D.; Lane, D., The empirical distribution of Fourier coefficients, The Annals of Statistics, 8, 6, 1244-1251 (1980) · Zbl 0449.62036
[12] Gottlieb, D.; Shu, C.-W., On the Gibbs phenomenon and its resolution, SIAM Review, 39, 4, 644-668 (1997) · Zbl 0885.42003
[13] Green, L.; Kolesar, P.; Svoronos, A., Some effects of nonstationarity on multiserver Markovian queueing systems, Operations Research, 39, 3, 502-511 (1991) · Zbl 0729.60100
[14] Hazra, M. M.; Morrice, D. J.; Park, S. K., A simulation clock-based solution to the frequency domain experiment indexing problem, IIE Transactions, 29, 769-782 (1997)
[15] Heidelberger, P.; Welch, P. D., Simulation run length control in the presence of an initial transient, Operations Research, 31, 6, 1109-1144 (1983) · Zbl 0532.65097
[16] Publisher: [Board of the Foundation of the Scandinavian Journal of Statistics, Wiley] · Zbl 0402.62058
[17] Houtveen, J. H.; Molenaar, P. C.M., Comparison between the Fourier and wavelet methods of spectral analysis applied to stationary and nonstationary heart period data, Psychophysiology, 38, 5, 729-735 (2001)
[18] Ibrahim, R.; Whitt, W., Wait-time predictors for customer service systems with time-varying demand and capacity, Operations Research, 59, 5, 1106-1118 (2011) · Zbl 1233.90117
[19] Jacobson, S. H.; Buss, A. H.; Schruben, L. W., Driving frequency selection for frequency domain simulation experiments, Operations Research, 39, 6, 917-924 (1991) · Zbl 0783.65058
[20] Jacobson, S. H.; Morrice, D.; Schruben, L. W., The global simulation clock as the frequency domain experiment index, Proceedings of the 1988 winter simulation conference, 558-563 (1988), IEEE
[21] Jerri, A. J., The Gibbs phenomenon in Fourier analysis (1998), Splines and Wavelet Approxima · Zbl 0918.42001
[22] Koo, I.; Zhang, X.; Kim, S., Wavelet- and Fourier-transform-based spectrum similarity approaches to compound identification in gas chromatography/mass spectrometry, Analytical chemistry, 83, 14, 5631-5638 (2011)
[23] Kulkarni, V.; Barat, S.; Clark, T., Towards adaptive enterprises using digital twins, Proceedings of the 2019 winter simulation conference, 60-74 (2019), IEEE
[24] Lada, E. K.; Wilson, J. R.; Steiger, N. M.; Joines, J. A., Performance of a wavelet-based spectral procedure for steady-state simulation analysis, INFORMS Journal on Computing; Linthicum, 19, 2, 150-160 (2007) · Zbl 1241.62127
[25] Laidler, G.; Morgan, L. E.; Nelson, B. L.; Pavlidis, N. G., Metric learning for simulation analytics, Proceedings of the 2020 winter simulation Conference (2020), IEEE: IEEE Piscataway, NJ, USA
[26] Law, A. M.; Carson, J. S., A sequential procedure for determining the length of a steady-state simulation, Operations Research, 27, 5, 1011-1025 (1979) · Zbl 0423.65008
[27] Leung, K. K., Load-dependent service queues with application to congestion control in broadband networks, Performance Evaluation, 50, 1, 27-40 (2002)
[28] Lin, Y.; Nelson, B. L.; Pei, L. J., Virtual statistics in simulation via k nearest neighbors, INFORMS Journal on Computing (2019) · Zbl 1451.90048
[29] Mandelbaum, A.; Massey, W. A., Strong approximations for time-dependent queues, Mathematics of Operations Research, 20, 1, 33-64 (1995) · Zbl 0834.60096
[30] Massey, W. A., The analysis of queues with time-varying rates for telecommunication models, Telecommunication Systems, 21, 2, 173-204 (2002)
[31] Moran, G.W., (1984). Locally-Weighted-Regression Scatter-Plot Smoothing (LOWESS) : A Graphical Exploratory Data Analysis Technique.https://calhoun.nps.edu/handle/10945/19419.
[32] Morgan, L. E.; Barton, R. R., Theoretical and Empirical Investigation of Fourier Trajectory Analysis for System Discrimination, Technical Report (2020), Lancaster University, Lancaster, UK
[33] Morrice, D. J., A comparison of frequency domain methodology and conventional factor screening methods, Operations Research Letters, 17, 4, 165-174 (1995) · Zbl 0835.65160
[34] Publisher: INFORMS · Zbl 0793.62051
[35] Morse, P. M., Stochastic properties of waiting lines, Journal of the Operations Research Society of America, 3, 3, 255-261 (1955) · Zbl 1414.90114
[36] Nedényi, F. K., An online change detection test for parametric discrete-time stochastic processes, Sequential Analysis, 37, 2, 246-267 (2018) · Zbl 1401.60037
[37] Nelson, B., Foundations and methods of stochastic simulation: A first course (2013), Springer Science & Business Media · Zbl 1266.91058
[38] Nelson, B. L., Some tactical problems in digital simulation for the next 10 years, Journal of Simulation, 10, 1, 2-11 (2016)
[39] Niyirora, J.; Zhuang, J., Fluid approximations and control of queues in emergency departments, European Journal of Operational Research, 261, 3, 1110-1124 (2017) · Zbl 1403.90245
[40] Parzen, E., On consistent estimates of the spectrum of a stationary time series, Annals of Mathematical Statistics, 28, 2, 329-348 (1957) · Zbl 0081.14102
[41] Parzen, E., Mathematical considerations in the estimation of spectra, Technometrics, 3, 2, 167-190 (1961) · Zbl 0101.12306
[42] Rayleigh (Strutt), J. W., The problem of the random walk, Nature, 72, 318 (1905) · JFM 36.0303.03
[43] Sargent, R. G.; Som, T. K., Current issues in frequency domain experimentation, Management Science, 38, 5, 667-687 (1992) · Zbl 0825.90408
[44] Scargle, J. D., Studies in astronomical time series analysis. II. Statistical aspects of spectral analysis of unevenly spaced data, The Astrphhysical Journal, 263, 835-853 (1982)
[45] Schmeiser, B., Batch size effects in the analysis of simulation output, Operations Research, 30, 3, 556-568 (1982) · Zbl 0484.65087
[46] Schruben, L. W.; Cogliano, V. J., An experimental procedure for simulation response surface model identification, Communications of the ACM, 30, 8, 716-730 (1987)
[47] Stankovic, L.; Dakovi, M.; Thayaparan, T., Time-frequency signal analysis with applications (2014), Artech House
[48] Steiger, N. M.; Lada, E. K.; Wilson, J. R.; Joines, J. A.; Alexopoulos, C.; Goldsman, D., ASAP3: A batch means procedure for steady-state simulation analysis, ACM Transactions on Modeling and Computer Simulation, 15, 1, 39-73 (2005) · Zbl 1478.62244
[49] Tirdad, A.; Grassmann, W. K.; Tavakoli, J., Optimal policies of M(t)/M/c/c queues with two different levels of servers, European Journal of Operational Research, 249, 3, 1124-1130 (2016) · Zbl 1346.90263
[50] Whitt, W.; Zhang, X., Periodic little’s law, Operations Research, 67, 1, 267-280 (2019) · Zbl 1458.60100
[51] Wu, X.; Barton, R. R., Fourier trajectory analysis for identifying system congestion, Proceedings of the 2016 winter simulation conference, 401-412 (2016), IEEE: IEEE Piscataway, NJ, USA
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.