Skip to main content

Advertisement

Log in

An approximate dynamic programming framework for modeling global climate policy under decision-dependent uncertainty

  • Original Paper
  • Published:
Computational Management Science Aims and scope Submit manuscript

Abstract

Analyses of global climate policy as a sequential decision under uncertainty have been severely restricted by dimensionality and computational burdens. Therefore, they have limited the number of decision stages, discrete actions, or number and type of uncertainties considered. In particular, two common simplifications are the use of two-stage models to approximate a multi-stage problem and exogenous formulations for inherently endogenous or decision-dependent uncertainties (in which the shock at time t+1 depends on the decision made at time t). In this paper, we present a stochastic dynamic programming formulation of the Dynamic Integrated Model of Climate and the Economy (DICE), and the application of approximate dynamic programming techniques to numerically solve for the optimal policy under uncertain and decision-dependent technological change in a multi-stage setting. We compare numerical results using two alternative value function approximation approaches, one parametric and one non-parametric. We show that increasing the variance of a symmetric mean-preserving uncertainty in abatement costs leads to higher optimal first-stage emission controls, but the effect is negligible when the uncertainty is exogenous. In contrast, the impact of decision-dependent cost uncertainty, a crude approximation of technology R&D, on optimal control is much larger, leading to higher control rates (lower emissions). Further, we demonstrate that the magnitude of this effect grows with the number of decision stages represented, suggesting that for decision-dependent phenomena, the conventional two-stage approximation will lead to an underestimate of the effect of uncertainty.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Arrow K (1962) The economic implications of learning by doing. Rev Econ Stud 29: 155–173

    Article  Google Scholar 

  • Baker E, Solak S (2011) Optimal climate change policy: R&D investments and abatement under uncertainty (under review)

  • Bellman R (2003) Dynamic programming. Dover, New York

    Google Scholar 

  • Bertsekas D (2007) Dynamic programming and optimal control. Athena Scientific, Belmont, MA

    Google Scholar 

  • Bertsekas D, Tsitsiklis J (1996) Neuro dynamic programming. Athena Scientific, Belmont, MA

    Google Scholar 

  • Crost B, Traeger C (2010) Risk and aversion in the integrated assessment of climate change (2010). CUDARE Working Paper No. 1104

  • Fasshauer G (2007) Meshfree approximation methods with Matlab. World Scientific, Singapore

    Google Scholar 

  • Gerst M, Howarth R, Borsuk M (2010) Accounting for the risk of extreme outcomes in an integrated assessment of climate change. Energy Policy 38(8): 4540–4548

    Article  Google Scholar 

  • Goel V, Grossmann I (2006) A class of stochastic programs with decision dependent uncertainty. Math Program 108(2): 355–394

    Article  Google Scholar 

  • Hammitt JK, Lempert RA, Schlesinger ME (1992) A sequential-decision strategy for abating climate change. Nature 357: 315–318

    Article  Google Scholar 

  • Jaffe A, Newell R, Stevins R (2003) Handbook of environmental economics vol, 1. In: Newell R (ed) Technological change and the environment. North-Holland/Elsevier, Amsterdam, pp 461–516

    Google Scholar 

  • Keefer D, Bodily S (1983) Three-point approximations for continuous random variables. Managt Sci 29(5): 595–609

    Article  Google Scholar 

  • Kelly D, Kolstad C (1999) Bayesian learning, growth, and pollution. J Econ Dyn Control 23: 491–518

    Article  Google Scholar 

  • Kolstad C (1996) Learning and stock effects in environmental regulation: the case of greenhouse gas emissions. J Environ Econ Manag 31: 1–18

    Article  Google Scholar 

  • Leach A (2007) The climate change learning curve. J Econ Dyn Control 31: 1728–1752

    Article  Google Scholar 

  • Lemoine D, Traeger C (2011) Tipping points and ambiguity in the integrated assessment of climate change. NBER Environmental and Energy Economics Summer Institute 2011 Paper

  • Manne A, Richels R (1994) The costs of stabilizing global co2 emissions: a probabilistic analysis based on expert judgment. Energy J 15(1): 31–56

    Google Scholar 

  • Martens P, Rotmans J (2003) Climate change: an integrated perspective. In: Martens P, Rotmans J, Jansen D, Vrieze K (eds) Climate change: an integrated perspective, advances in global change research, vol 1. Springer, Netherlands, pp 1–

    Chapter  Google Scholar 

  • McKay MD, Beckman RJ, Conover WJ (1979) A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21(2): 239–245

    Google Scholar 

  • Nordhaus W (2007) The challenge of global warming: economic models and environmental policy. Available at: http://nordhaus.econ.yale.edu/ (2007). NBER Working Paper 14832

  • Nordhaus W, Boyer J (2000) Warming the world: economic modeling of global warming. MIT Press, Cambridge, MA

    Google Scholar 

  • Nordhaus W, Popp D (1997) What is the value of scientific knowledge? an application to global warming using the price model. Energy J 18(1): 1–45

    Google Scholar 

  • Parpas P, Webster M (2011) A stochastic minimum principle and a mesh-free method for stochastic optimal control (submitted)

  • Popp D, Newell R, Jaffe A (2009) Energy, the environment, and technological change. howpublished. NBER Working Paper 14832

  • Powell W (2007) Approximate dynamic programming: solving the curses of dimensionality, vol 703. Wiley-Blackwell, New York

    Book  Google Scholar 

  • Reilly J, Edmonds J, Gardner R, Brenkert A (1987) Monte carlo analysis of the iea/orau energy/carbon emissions model. Energy J 8(3): 1–29

    Google Scholar 

  • Scott M, Sands R, Edmonds J, Liebetrau A, Engel D (1999) Uncertainty in integrated assessment models: modeling with minicam 1.0. Energy Policy 27(14): 597–603

    Article  Google Scholar 

  • Webster M (2002) The curious role of learning: should we wait for more data?. Energy J 23: 97–119

    Google Scholar 

  • Webster M (2008) Incorporating path-dependency into decision analytic methods: an application to global climate change policy. Decis Anal 5(2): 60–75

    Article  Google Scholar 

  • Webster M, Jakobovits L, Norton J (2008) A class of stochastic programs with decision dependent uncertainty. Clim Change 89(1-2): 67–85

    Article  Google Scholar 

  • Webster M, Paltsev S, Parsons J, Reilly J, Jacoby H (2008) Uncertainty in greenhouse emissions and costs of atmospheric stabilization. Tech rep, MIT JPSPGC, Report No. 165

  • Webster M, Sokolov A, Reilly J, Forest C, Paltsev S, Schlosser A, Wang C, Kicklighter D, Sarofim M, Melillo J, Prinn R, Jacoby H (2009) Analysis of climate policy targets under uncertainty. Tech. rep, MIT JPSPGC, Report No 180

  • Weyant J, Davidson O, Dowlabathi H, Edmonds J, Grubb M, Parson E, Richels R, Rotmans J, Shukla P, Tol R, Cline W, Fankhauser S (1996) Integrated assessment of climate change: an overview and comparison of approaches and results. In: Economic and social dimensions of climate change, equity and social considerations. Contribution of Working Group III to the Second Assessment Report of the Intergovernmental Panel on Climate Change, chap. Integrated assessment of climate change: an overview and comparison of approaches and results, Cambridge University Press, CAmbridge, pp. 367–396

  • Wright T (1936) Factors affecting the cost of airplanes. J Aeronaut Sci 3: 122–128

    Google Scholar 

  • Wright T (1982) Inside the black box: technology and economics. Cambridge University Press, Cambridge

    Google Scholar 

  • Yohe G, Andronova N, Schlesinger M (2004) To hedge or not against an uncertain climate future?. Science 306: 416–417

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mort Webster.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Webster, M., Santen, N. & Parpas, P. An approximate dynamic programming framework for modeling global climate policy under decision-dependent uncertainty. Comput Manag Sci 9, 339–362 (2012). https://doi.org/10.1007/s10287-012-0147-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10287-012-0147-1

Keywords

Navigation