Skip to main content
Log in

On discounted dynamic programming with unbounded returns

  • Research Article
  • Published:
Economic Theory Aims and scope Submit manuscript

Abstract

In this paper, we apply the idea of k-local contraction of Rincón-Zapatero and Rodriguez-Palmero (Econometrica 71:1519–1555, 2003; Econ Theory 33:381–391, 2007) to study discounted stochastic dynamic programming models with unbounded returns. Our main results concern the existence of a unique solution to the Bellman equation and are applied to the theory of stochastic optimal growth. Also a discussion of some subtle issues concerning k-local and global contractions is included.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Berge C.: Topological Spaces. MacMillan, New York (1963)

    Google Scholar 

  • Bertsekas D.P., Shreve S.E.: Stochastic Optimal Control: The Discrete-Time Case. Academic Press, New York (1978)

    Google Scholar 

  • Blackwell D.: Discounted dynamic programming. Ann Math Stat 36, 226–235 (1965)

    Article  Google Scholar 

  • Boyd J.H. III: Recursive utility and the Ramsey problem. J Econ Theory 50, 326–345 (1990)

    Article  Google Scholar 

  • Boyd J.H. III, Becker R.A.: Capital Theory, Equilibrium Analysis and Recursive Utility. Blackwell, New York (1997)

    Google Scholar 

  • Brock W.A., Mirman L.J.: Optimal economic growth and uncertainty: the discounted case. J Econ Theory 4, 479–513 (1972)

    Article  Google Scholar 

  • Brown L.D., Purves R.: Measurable selections of extrema. Ann Stat 1, 902–912 (1973)

    Article  Google Scholar 

  • Dana, R.A., Le Van, C., Mitra, T., Nishimura, K. (eds): Handbook of Optimal Growth 1. Springer, Berlin (2006)

    Google Scholar 

  • Durán J.: Discounting long run average growth in stochastic dynamic programs. Econ Theory 22, 395–413 (2003)

    Article  Google Scholar 

  • Dutta P.K., Mitra T.: On continuity of the utility function in intertemporal allocation models: an example. Int Econ Rev 30, 527–536 (1989)

    Article  Google Scholar 

  • Dutta P.K., Sundaram R.: Markovian equilibrium in a class of stochastic games: existence theorems for discounted and undiscounted models. Econ Theory 2, 197–214 (1992)

    Article  Google Scholar 

  • Hernández-Lerma O., Lasserre J.B.: Further Topics on Discrete-Time Markov Control Processes. Springer-Verlag, New York (1999)

    Google Scholar 

  • Himmelberg C.J.: Measurable relations. Fund Math 87, 53–72 (1975)

    Google Scholar 

  • Kuratowski K., Ryll-Nardzewski C.: A general theorem on selectors. Bull Polish Acad Sci (Ser Math) 13, 397–403 (1965)

    Google Scholar 

  • Le Van C., Morhaim L.: Optimal growth models with bounded or unbounded returns: a unifying approach. J Econ Theory 105, 158–187 (2002)

    Article  Google Scholar 

  • Le Van C., Vailakis Y.: Recursive utility and optimal growth with bounded or unbounded returns. J Econ Theory 123, 187–209 (2005)

    Article  Google Scholar 

  • Martins-da-Rocha, V.F., Vailakis, Y.: Existence and uniqueness of fixed-point for local contractions. Econometrica (2008)

  • Neveu J.: Mathematical Foundations of the Calculus of Probability. Holden-Day, San Francisco (1965)

    Google Scholar 

  • Nowak A.S.: On zero-sum stochastic games with general state space I. Probab Math Stat 4, 13–32 (1984)

    Google Scholar 

  • Nowak A.S.: Universally measurable strategies in zero-sum stochastic games. Ann Probab 13, 269–287 (1985)

    Article  Google Scholar 

  • Nowak A.S., Raghavan T.E.S.: Existence of stationary correlated equilibria with symmetric information for discounted stochastic games. Math Oper Res 17, 519–526 (1992)

    Article  Google Scholar 

  • Puterman M.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley-Interscience, New York (2005)

    Google Scholar 

  • Rincón-Zapatero J.P., Rodriguez-Palmero C.: Existence and uniqueness of solutions to the Bellman equation in the unbounded case. Econometrica 71, 1519–1555 (2003)

    Article  Google Scholar 

  • Rincón-Zapatero J.P., Rodriguez-Palmero C.: Recursive utility with unbounded aggregators. Econ Theory 33, 381–391 (2007)

    Article  Google Scholar 

  • Rincón-Zapatero, J.P., Rodriguez-Palmero, C.: Corrigendum to “Existence and uniqueness of solutions to the Bellman equation in the unbounded case”. Econometrica 71, 1519–1555 (2003). Econometrica 77, 317–318 (2009)

    Google Scholar 

  • Schäl M.: Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal. Z Wahrsch verw Geb 32, 179–196 (1975)

    Article  Google Scholar 

  • Stokey N.L., Lucas R.E., Prescott E.: Recursive Methods in Economic Dynamics. Harvard University Press, Cambridge (1989)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrzej S. Nowak.

Additional information

We wish to thank an associate editor and two referees for many constructive and helpful comments.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Matkowski, J., Nowak, A.S. On discounted dynamic programming with unbounded returns. Econ Theory 46, 455–474 (2011). https://doi.org/10.1007/s00199-010-0522-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00199-010-0522-5

Keywords

JEL Classification

Navigation