Information nonanticipative rate distortion function and its applications. (English) Zbl 1404.94008
van Schuppen, Jan H. (ed.) et al., Coordination control of distributed systems. Cham: Springer (ISBN 978-3-319-10406-5/pbk; 978-3-319-10407-2/ebook). Lecture Notes in Control and Information Sciences 456, 317-324 (2015).
Summary: In this chapter, we introduce the information nonanticipative rate distortion function (RDF), and we compare it with the classical information RDF, identifying certain limitations of the later, with respect to nonanticipative or real-time transmission for delay-sensitive applications. Then, we proceed further to describe applications of nonanticipative RDF in (1) joint source-channel coding (JSCC) using nonanticipative (delayless) transmission, and in (2) bounding the optimal performance theoretically attainable (OPTA) by noncausal and causal codes for general sources. Finally, to facilitate the application of the information nonanticipative RDF in computing the aforementioned bounds and in applying it to JSCC based on nonanticipative transmission, we proceed further to present the expression of the optimal reproduction distribution for nonstationary sources.
For the entire collection see [Zbl 1310.93004].
For the entire collection see [Zbl 1310.93004].
MSC:
| 94A08 | Image processing (compression, reconstruction, etc.) in information and communication theory |
| 93A30 | Mathematical modelling of systems (MSC2010) |
Keywords:
source symbol; average fidelity; fidelity constraint; reproduction sequence; error exponentReferences:
| [1] | Berger T (1971) Rate distortion theory: a mathematical basis for data compression. Prentice-Hall, Englewood Cliffs · Zbl 0200.00001 |
| [2] | Neuhoff DL, Gilbert RK (1982) Causal source codes. IEEE Trans Inf Theor 28(5):701-713 · Zbl 0515.94015 · doi:10.1109/TIT.1982.1056552 |
| [3] | Charalambous CD, Farhadi A (2008) LQG optimality and separation principle for general discrete time partially observed stochastic systems over finite capacity communication channels. Automatica 44(12):3181-3188 · Zbl 1153.93530 |
| [4] | Charalambous CD, Kourtellaris CK, Hadjicostis C (2011) Optimal encoder and control strategies in stochastic control subject to rate constraints for channels with memory and feedback. In: 50th IEEE CDC/ECC, 12-15 Dec 2011, pp 4522-â4527 |
| [5] | Charalambous CD, Stavrou PA (2012) Directed information on abstract spaces: properties and extremum problems. In: IEEE international symposium on information theory (ISIT), Cambridge, MA, USA, 1-â6 Jul 2012, pp 518-522 |
| [6] | Stavrou PA, Kourtellaris CK, Charalambous CD (2014) Information nonanticipative rate distortion function and its applications. IEEE Trans Inf Theor (submitted) [Online]. Available: http://arxiv.org/abs/1405.1593v1 |
| [7] | Berger T (1977) Explicit bounds to R(D) for a binary symmetric Markov source. IEEE Trans Inf Theor 23(1):52-59 · Zbl 0359.94027 |
| [8] | Berger T (2003) Living information theory. IEEE Inf Theor Soc Newslett 53(1):6-19 |
| [9] | Charalambous CD, Stavrou PA, Ahmed NU (2014) Nonanticipative rate distortion function and relations to filtering theory. IEEE Trans Autom Control 59(4):357-352 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
