Martingale properties of an information-feedback loop. (English) Zbl 0647.62013
This paper extends some of the previous authors’ results to the case in which the data generated by the information feedback loop is numerical rather than categorical. Estimated average utility scores associated with each possible course of action are shown to be uniformly integrable martingale sequences. Strong convergence properties of these sequences are demonstrated.
Reviewer: M.P.Mokljacuk
MSC:
| 62B10 | Statistical aspects of information-theoretic topics |
| 60G35 | Signal detection and filtering (aspects of stochastic processes) |
| 94A15 | Information theory (general) |
Keywords:
information systems; information feedback loop; Estimated average utility scores; uniformly integrable martingale sequencesReferences:
| [1] | Yovits, M. C.; Foulk, C. R.; Rose, L. L., Information flow and analysis: theory, simulation and experiment. Part I. Basic theoretical and conceptual development, J. Am. Soc. Inf. Sci., 32, 187-202 (1981) |
| [2] | Yovits, M. C.; Foulk, C. R.; Rose, L. L., Information flow and analysis: theory, simulation and experiment. Part II. Simulation; examples and results, J. Am. Soc. Inf. Sci., 32, 203-210 (1981) |
| [3] | Yovits, M. C.; Foulk, C. R., Experiments and analysis of information, use and value in a decision-making context, J. Am. Soc. Inf. Sci., 36, 63-81 (1985) |
| [4] | Marshak, J., Problems in information economics, (Management Controls (1964), McGraw-Hill: McGraw-Hill New York) |
| [5] | Zunde, P., Information measurement and value, 3rd A. Symp. Am. Soc. Cybernet. (1969), Gaithersburg, Md |
| [6] | Bandyopadhyay, R., Information for organized decision making, a literature review, IEEE Trans. Syst. Man Cybernet., 7, 1-15 (1977) |
| [7] | Alo, R.; Kleyle, R.; de Korvin, A., Decision making mechanisms and stopping times in a generalized information system, Mathl Modelling, 6, 259-271 (1985) · Zbl 0584.62007 |
| [8] | Kleyle, R.; de Korvin, A., Switching mechanisms in a generalized information system, Cybernet. Syst., 15, 145-167 (1984) · Zbl 0551.90051 |
| [9] | de Korvin, A.; Kleyle, R., Goal uncertainty in a generalized information system: convergence properties of the estimated expected utilities, Stochastic Analysis Applic., 2, 437-457 (1984) · Zbl 0547.90050 |
| [10] | Alo, R.; de Korvin, A.; Kleyle, R., Emergence of a dominant course of action in a general feedback loop when goal uncertainty is present, J. Am. Soc. Int. Sci., 38, 111-117 (1987) |
| [11] | Debreu, G., Integration of correspondences, Proc. 5th Berkeley Symp. on Maths. Statist. Probabil., II, 351-372 (1966), (Part I) · Zbl 0211.52803 |
| [12] | Aumann, R., Existence of competitive equilibria in markets with a continuum of traders, Econometrica, 34, 1-17 (1966) · Zbl 0142.17201 |
| [13] | Artstein, Z., Weak convergence of set valued functions and controls, SIAM Jl Control, 13, 865-878 (1975) · Zbl 0276.93015 |
| [14] | Von Neumann, J.; Morgenstern, O., (Theory of Games and Economic Behavior (1967), Wiley: Wiley New York) · Zbl 0205.23401 |
| [15] | Ferguson, T. A., Mathematical Statistics: a Decision Theoretic Approach (1967), Academic Press: Academic Press New York · Zbl 0153.47602 |
| [16] | Kahneman, D.; Tversky, A., The psychology of preferences, Scient. Am., 246, 160-175 (1982) |
| [17] | Breiman, L., Probability (1968), Addison-Wesley: Addison-Wesley Reading, Mass · Zbl 0174.48801 |
| [18] | Doob, J., Stochastic Processes (1953), Wiley: Wiley New York · Zbl 0053.26802 |
| [19] | Chatterji, S. D., Martingale convergence and the Raydon-Nikodym theorem in Banach spaces, Mathematica scand., 22, 21-41 (1968) · Zbl 0175.14503 |
| [20] | Scalora, F. S., Abstract martingale convergence theorems, Pacif. J. Math., 11, 347-374 (1961) · Zbl 0114.07702 |
| [21] | Metivier, M., Martingales a valeurs vectorielles. Applications a la derivation des musures vectorielles, Annls Inst. Fourier Univ. Grenoble, 17, 175-208 (1967) · Zbl 0162.48801 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
