An evaluation of multi-criteria methods in integrated assessment of climate policy. (English) Zbl 0999.91507
Summary: Those who conduct Integrated Assessments (IAs) are aware of the need to explicitly consider multiple criteria and uncertainties when evaluating policies for preventing global warming. MCDM methods are potentially useful for understanding tradeoffs and evaluating risks associated with climate policy alternatives. A difficulty facing potential MCDM users is the wide range of different techniques that have been proposed, each with distinct advantages. Methods differ in terms of validity, ease of use, and appropriateness to the problem. Alternative methods also can yield strikingly different rankings of alternatives. A workshop was held in which climate change experts and policy makers evaluated the usefulness of MCDM for IA. Participants applied several methods in the context of a hypothetical greenhouse gas policy decision. Methods compared include value and utility functions, goal programming, ELECTRE, fuzzy sets, stochastic dominance, min max regret, and several weight selection methods. Ranges, rather than point estimates, were provided for some questions to incorporate imprecision regarding weights. Additionally, several visualization methods for both deterministic and uncertain cases were used and evaluated. Analysis of method results and participant feedback through questionnaires and discussion provide the basis for conclusions regarding the use of MCDM methods for climate change policy and IA analyses. Hypotheses are examined concerning predictive and convergent validity of methods, existence of splitting bias among experts, perceived ability of methods to aid decision-making, and whether expressing imprecision can change ranking results. Because participants gained from viewing a problem from several perspectives and results from different methods often significantly differed, it appears worthwhile to apply several MCDM methods to increase user confidence and insight. The participants themselves recommended such multimethod approaches for policymaking. Yet they preferred the freedom of unaided decision-making most of all, challenging the MCDM community to create transparent methods that permit maximum user control.
MSC:
| 91B76 | Environmental economics (natural resource models, harvesting, pollution, etc.) |
| 91B06 | Decision theory |
| 90B50 | Management decision making, including multiple objectives |
Keywords:
integrated assessment; method evaluation; multi-criteria decision-making; climate change; experiment; weight selection; policy analysisReferences:
| [1] | Adelman, IEEE Transactions on Systems, Man, and Cybernetics 21 pp 293– (1991) · doi:10.1109/21.87078 |
| [2] | 1996a. Decision-making framework for addressing climate change. In Climate Change 1995: Economic and Social Dimensions of Climate Change, Intergovernmental Panel on Climate Change (IPCC), (eds). Cambridge University Press: New York. |
| [3] | 1996b. Intertemporal equity, discounting, and economic efficiency. In Climate Change 1995: Economic and Social Dimensions of Climate Change, IPCC, (eds). Cambridge University Press: New York. |
| [4] | Becker, Journal of Multi-Criteria Decision Analysis 7 pp 13– (1998) · Zbl 0904.90092 · doi:10.1002/(SICI)1099-1360(199801)7:1<3::AID-MCDA172>3.0.CO;2-J |
| [5] | Bellman, Management Science 17 pp 141– (1970) · Zbl 0224.90032 · doi:10.1287/mnsc.17.4.B141 |
| [6] | Belton, European Journal of Operational Research 26 pp 7– (1986) · doi:10.1016/0377-2217(86)90155-4 |
| [7] | 1992. Joint Climate Project to Address Decision Makers’ Uncertainties. Science and Policy Assoc., Inc.: Washington, DC. |
| [8] | Borcherding, Management Science 37 pp 1603– (1991) · Zbl 0729.91012 · doi:10.1287/mnsc.37.12.1603 |
| [9] | Brown, Theory and Decision 20 pp 133– (1986) · doi:10.1007/BF00135089 |
| [10] | Corner, European Journal of Operational Research 98 pp 85– (1997) · Zbl 0920.90080 · doi:10.1016/0377-2217(95)00326-6 |
| [11] | 1975. Group Techniques for Program Planning?A Guide to Nominal Group and Delphi Processes. Scott Foresman and Company: Glenview. |
| [12] | Dowlatabadi, Science 259 pp 1813– (1993) · doi:10.1126/science.259.5103.1813 |
| [13] | Edwards, IEEE Transactions on Systems, Man, and Cybernetics 7 pp 326– (1977) · doi:10.1109/TSMC.1977.4309720 |
| [14] | 1995. Research Methods in Psychology, 5th Edition. West Publishing Co.: St. Paul, MN. |
| [15] | 1992. Description and Procedure Invariance in Multiattribute Utility Measurement. Purdue University School of Management: West Lafayette, IN. |
| [16] | Evans, Information and Management 16 pp 197– (1989) · doi:10.1016/0378-7206(89)90037-2 |
| [17] | Gardiner, TIMS Studies in Management Studies 14 pp 241– (1980) |
| [18] | 1982. Multiobjective Decision Analysis with Engineering and Business Applications. Wiley: New York. |
| [19] | Gunderson, Journal of End User Computing 7 pp 3– (1995) |
| [20] | Hadley, Journal of Multi-Criteria Analysis 6 pp 140– (1997) · Zbl 0889.90095 · doi:10.1002/(SICI)1099-1360(199705)6:3<140::AID-MCDA128>3.0.CO;2-T |
| [21] | Hammitt, Nature 357 pp 315– (1992) · doi:10.1038/357315a0 |
| [22] | Hobbs, IEEE Transactions on Systems, Man, and Cybernetics 16 pp 384– (1986) · doi:10.1109/TSMC.1986.4308970 |
| [23] | Hobbs, Water Resources Research 28 pp 1767– (1992) · doi:10.1029/92WR00712 |
| [24] | Hobbs, Energy Policy 25 pp 357– (1997) · doi:10.1016/S0301-4215(97)00025-6 |
| [25] | 2000. Energy Decisions and the Environment: A Guide to the Use of Multi-Criteria Methods. Kluwer Academic Publishers: Boston. · doi:10.1007/978-1-4615-4477-7 |
| [26] | Holmes, Environmental Science and Technology 30 pp 348– (1996) · doi:10.1021/es962364q |
| [27] | Holmes, Environmental Management 21 pp 669– (1997) · doi:10.1007/s002679900059 |
| [28] | Huber, Management Science 10 pp 1393– (1974) · Zbl 0303.90001 · doi:10.1287/mnsc.20.10.1393 |
| [29] | Intergovernmental Panel on Climate Change (IPCC), Working Group I. 1995. Climate Change 1995: The Science of Climate Change. (eds.). Cambridge University Press: New York. |
| [30] | 1998. Decision analysis and rational action. In Human Choice and Climate Change, (eds.). Battelle Press: Columbus, Ohio. |
| [31] | 1978. Importance weight assessment for additive riskless preference functions: a review. Research Report 78-5. Social Sciences Research Institute, University of Southern California: Los Angeles, CA. |
| [32] | Kahneman, Psychological Review 80 pp 237– (1973) · doi:10.1037/h0034747 |
| [33] | 1976. Decisions with Multiple Objectives. Wiley: Cambridge, Massachusetts. |
| [34] | Korhonen, Journal of Multi-Criteria Decision Analysis pp 233– (1997) · Zbl 0890.90116 · doi:10.1002/(SICI)1099-1360(199707)6:4<233::AID-MCDA156>3.0.CO;2-S |
| [35] | Lai, Environmental Planning 22 pp 21– (1995) · doi:10.1068/b220021 |
| [36] | Larichev, Journal of Multi-Criteria Decision Analysis 1 pp 127– (1992) · Zbl 0838.90071 · doi:10.1002/mcda.4020010303 |
| [37] | León, Organizational Behavior and Human Decision Processes 71 pp 249– (1997) · doi:10.1006/obhd.1997.2719 |
| [38] | Leung, Behavioral Science 23 pp 478– (1978) · doi:10.1002/bs.3830230509 |
| [39] | Loomes, The Economic Journal 92 pp 805– (1982) · doi:10.2307/2232669 |
| [40] | 1992. Buying Greenhouse Insurance: The Economic Costs of Carbon Dioxide Emission Limits. MIT Press: Cambridge, Massachusetts. |
| [41] | Meo, Global Environmental Change 1 pp 124– (1991) · doi:10.1016/0959-3780(91)90019-P |
| [42] | Morgan, Environmental Science & Technology 29 pp 468a– (1995) |
| [43] | National Acid Precipitation Assessment Program (NAPAP). 1991. The Experience and Legacy of NAPAP, Report to the Joint Chairs Council of the Interagency Task Force on Acidic Deposition. NAPAP Oversight Review Board: Washington, DC. |
| [44] | 1995. Searching for Integrated Assessment: A Preliminary Investigation of Methods, Models, and Projects in the Integrated Assessment of Global Climate Change. Consortium for International Earth Science Information Network: University Center, MI. |
| [45] | Park, Journal of Operational Research 47 pp 1415– (1996) · Zbl 0863.90099 · doi:10.1057/jors.1996.178 |
| [46] | Peck, Risk Analysis 16 pp 227– (1996) · doi:10.1111/j.1539-6924.1995.tb00781.x |
| [47] | Pöyhönen, INFOR 38 pp 272– (2000) |
| [48] | Pöyhönen, European Journal of Operational Research 129 pp 569– (2001) · Zbl 1125.90368 · doi:10.1016/S0377-2217(99)00467-1 |
| [49] | 1982. The Art and Science of Negotiation. Belnap Press: Cambridge. |
| [50] | Ridgley, Energy Policy 24 pp 517– (1996) · doi:10.1016/0301-4215(96)00034-1 |
| [51] | 1998. Integrated assessment modeling. In Human Choice and Climate Change, (eds.). Battelle Press: Columbus, OH. |
| [52] | 1980. The Analytical Hierarchy Process. McGraw-Hill: New York. |
| [53] | Sarin, The International Journal of Management Science 5 pp 481– (1977) |
| [54] | 1981. Behavioral issues in multiattribute utility modeling and decision analysis. In Organizations: Multiple Agents with Multiple Criteria, (Ed.). Springer-Verlag: New York. |
| [55] | 1994. Climate change and discount rates. In Steps Towards a Decision Making Framework to Address Climate Change: Report from the Montreuz IPCC WG III Writing Team II Meeting, March 3-6, 1994, (eds). Paul Scherrer Institut: Switzerland. |
| [56] | Shlyakhter, Chemosphere 30 pp 1585– (1995) · doi:10.1016/0045-6535(95)00032-4 |
| [57] | Simpson, Journal of the Operational Research Society 47 pp 919– (1996) · Zbl 0864.90071 · doi:10.1057/jors.1996.117 |
| [58] | Stewart, OMEGA 20 pp 569– (1992) · doi:10.1016/0305-0483(92)90003-P |
| [59] | 2000. Policy decisions in the public sector: can MCDA make a difference? In Research and Practice in Multiple Criteria Decision Making, (eds.). Springer: Berlin. |
| [60] | Stillwell, Management Science 33 pp 442– (1987) · doi:10.1287/mnsc.33.4.442 |
| [61] | Valverde, The Journal of Environmental Modeling and Assessment 4 pp 87– (1999) · doi:10.1023/A:1019056032181 |
| [62] | 1986. Decision Analysis and Behavioral Research. Cambridge University Press. |
| [63] | Weber, European Journal of Operational Research 28 pp 44– (1987) · Zbl 0604.90004 · doi:10.1016/0377-2217(87)90168-8 |
| [64] | Zapatero, Journal of Multi-Criteria Decision Analysis 6 pp 201– (1997) · Zbl 0891.90092 · doi:10.1002/(SICI)1099-1360(199707)6:4<201::AID-MCDA138>3.0.CO;2-Z |
| [65] | 1982. Multiple Criteria Decision Making. McGraw-Hill: New York. · Zbl 0588.90019 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
