×

Analyzing anchoring bias in attribute weight elicitation of SMART, Swing, and best-worst method. (English) Zbl 07797300

Summary: In this study, the existence of anchoring bias – people’s tendency to rely on, evaluate, and decide based on the first piece of information they receive – is examined in two multi-attribute decision-making (MADM) methods, simple multi-attribute rating technique (SMART), and Swing. Data were collected from university students for a transportation mode selection. Data analysis revealed that the two methods, which have different starting points, display different degrees of anchoring bias. Statistical analyses of the weights obtained from the two methods show that, compared to Swing (with a high anchor), SMART (with a low anchor) produces lower weights for the least important attributes, while for the most important attributes, the opposite is true. Despite their differences in anchoring bias, analytical approaches supported by empirical studies suggest that both methods (SMART and Swing) overweigh the less important attributes and underweigh the more important attributes. As such, we examined whether the best-worst method (BWM), which has two opposite anchors in its procedure (a possible promising anchoring debiasing strategy), could produce results that are less prone to anchoring bias. Our findings show that the BWM is indeed able to produce lower weights (compared to SMART and Swing) for the less important attributes and higher weights for the more important attributes. This study shows the vulnerability of MADM methods with a single anchor and supports the idea that MADM methods with multiple (opposite) anchors, like BWM, are less prone to anchoring bias.
© 2022 The Authors. International Transactions in Operational Research published by John Wiley & Sons Ltd on behalf of International Federation of Operational Research Societies

MSC:

90-XX Operations research, mathematical programming

Software:

G*Power 3

References:

[1] Abel, E., Galpin, I., Paton, N.W., Keane, J.A., 2020. Pairwise comparisons or constrained optimization? A usability evaluation of techniques for eliciting decision priorities. International Transactions in Operational Research 295, 3190-3206. · Zbl 07772010
[2] Adame, B.J., 2016. Training in the mitigation of anchoring bias: a test of the consider‐the‐opposite strategy. Learning and Motivation53, 36-48.
[3] Anwyl‐Irvine, A.L., Massonnié, J., Flitton, A., Kirkham, N., Evershed, J.K., 2020. Gorilla in our midst: an online behavioral experiment builder. Behavior Research Methods52, 1, 388-407.
[4] Asgharizadeh, E., Taghizadeh Yazdi, M., Mohammadi Balani, A., 2019. An output‐oriented classification of multiple attribute decision‐making techniques based on fuzzy c‐means clustering method. International Transactions in Operational Research26, 6, 2476-2493. · Zbl 07766404
[5] Bazerman, M.H., Moore, D.A., 1994. Judgment in Managerial Decision Making. Wiley, New York.
[6] Bergman, O., Ellingsen, T., Johannesson, M., Svensson, C., 2010. Anchoring and cognitive ability. Economics Letters107, 1, 66-68.
[7] Bodenhausen, G.V., Gabriel, S., Lineberger, M., 2000. Sadness and susceptibility to judgmental bias: the case of anchoring. Psychological Science11, 4, 320-323.
[8] Borcherding, K., vonWinterfeldt, D., 1988. The effect of varying value trees on multiattribute evaluations. Acta Psychologica68, 1‐3, 153-170.
[9] Bottomley, P.A., Doyle, J.R., 2001. A comparison of three weight elicitation methods: good, better, and best. Omega29, 6, 553-560.
[10] Buchanan, J.T., Corner, J., 1997. The effects of anchoring in interactive MCDM solution methods. Computers & Operations Research24, 10, 907-918. · Zbl 0901.90135
[11] Caputo, A., 2014. Relevant information, personality traits and anchoring effect. International Journal of Management and Decision Making13, 1, 62-76.
[12] Chapman, G.B., Johnson, E.J., 1994. The limits of anchoring. Journal of Behavioral Decision Making7, 4, 223-242.
[13] Cho, I., Wesslen, R., Karduni, A., Santhanam, S., Shaikh, S., Dou, W., 2017. The anchoring effect in decision‐making with visual analytics. 2017 IEEE Conference on Visual Analytics Science and Technology (VAST), October 3-6, Phoenix, AZ, pp. 116-126.
[14] Corner, J.L., Buchanan, J.T., 1997. Capturing decision maker preference: experimental comparison of decision analysis and MCDM techniques. European Journal of Operational Research98, 1, 85-97. · Zbl 0920.90080
[15] Critcher, C.R., Gilovich, T., 2008. Incidental environmental anchors. Journal of Behavioral Decision Making21, 3, 241-251.
[16] deWilde, T.R., Ten Velden, F.S., deDreu, C.K., 2018. The anchoring bias in groups. Journal of Experimental Social Psychology76, 116-126.
[17] Deniz, N., 2020. Cognitive biases in MCDM methods: an embedded filter proposal through sustainable supplier selection problem. Journal of Enterprise Information Management33, 5, 947-963.
[18] Downen, T., Furner, Z., Cataldi, B., 2019. The effects on anchoring of increasing quantities of disconfirming evidence. International Journal of Management and Decision Making18, 3, 309-331.
[19] Doyle, J.R., Green, R.H., Bottomley, P.A., 1997. Judging relative importance: direct rating and point allocation are not equivalent. Organizational Behavior and Human Decision Processes70, 1, 65-72.
[20] Edwards, W., 1977. How to use multiattribute utility measurement for social decisionmaking. IEEE Transactions on Systems, Man, and Cybernetics7, 5, 326-340.
[21] Englich, B., Soder, K., 2009. Moody experts—How mood and expertise influence judgmental anchoring. Judgment and Decision Making4, 1, 41.
[22] Epley, N., Gilovich, T., 2005. When effortful thinking influences judgmental anchoring: differential effects of forewarning and incentives on self‐generated and externally provided anchors. Journal of Behavioral Decision Making18, 3, 199-212.
[23] Epley, N., Gilovich, T., 2006. The anchoring‐and‐adjustment heuristic: why the adjustments are insufficient. Psychological Science17, 4, 311-318.
[24] Eroglu, C., Croxton, K.L., 2010. Biases in judgmental adjustments of statistical forecasts: the role of individual differences. International Journal of Forecasting26, 1, 116-133.
[25] Esch, F.R., Schmitt, B.H., Redler, J., Langner, T., 2009. The brand anchoring effect: a judgment bias resulting from brand awareness and temporary accessibility. Psychology & Marketing26, 4, 383-395.
[26] Estrada, C.A., Isen, A.M., Young, M.J., 1997. Positive affect facilitates integration of information and decreases anchoring in reasoning among physicians. Organizational Behavior and Human Decision Processes72, 1, 117-135.
[27] Faul, F., Erdfelder, E., Buchner, A., Lang, A.‐G., 2009. Statistical power analyses using G* Power 3.1: tests for correlation and regression analyses. Behavior Research Methods41, 4, 1149-1160.
[28] Faul, F., Erdfelder, E., Lang, A.‐G., Buchner, A., 2007. G* Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods39, 2, 175-191.
[29] Fischer, G.W., 1995. Range sensitivity of attribute weights in multiattribute value models. Organizational Behavior and Human Decision Processes62(3), 252-266.
[30] Fischer, G. W., Damodaran, N., Laskey, K. B., Lincoln, D., 1987. Preferences for proxy attributes. Management Science33(2), 198-214.
[31] Fox, C.R., Clemen, R.T., 2005. Subjective probability assessment in decision analysis: partition dependence and bias toward the ignorance prior. Management Science51, 9, 1417-1432.
[32] Furnham, A., Boo, H.C., 2011. A literature review of the anchoring effect. The Journal of Socio‐Economics40, 1, 35-42.
[33] Gabrielli, W.F.Jr., vonWinterfeldt, D., 1978. Are important weights sensitive to the range of alternatives in multiattribute utility measurement. Available at: https://apps.dtic.mil/sti/citations/ADA073366 (accessed 1 March 2020).
[34] George, J.F., Duffy, K., Ahuja, M., 2000. Countering the anchoring and adjustment bias with decision support systems. Decision Support Systems29, 2, 195-206.
[35] Gettinger, J., Kiesling, E., Stummer, C., Vetschera, R., 2013. A comparison of representations for discrete multi‐criteria decision problems. Decision Support Systems54, 2, 976-985.
[36] Hämäläinen, R.P., Alaja, S., 2008. The threat of weighting biases in environmental decision analysis. Ecological Economics68, 1‐2,556-569.
[37] Jacobi, S.K., Hobbs, B.F., 2007. Quantifying and mitigating the splitting bias and other value tree‐induced weighting biases. Decision Analysis4, 4, 194-210.
[38] Jetter, M., Walker, J.K., 2017. Anchoring in financial decision‐making: evidence from Jeopardy!Journal of Economic Behavior & Organization141, 164-176.
[39] Kaustia, M., Alho, E., Puttonen, V., 2008. How much does expertise reduce behavioral biases? The case of anchoring effects in stock return estimates. Financial Management37, 3, 391-412.
[40] Korhonen, P., Wallenius, J., 1997. Behavioral issues in MCDM: Neglected research questions. In Climaco, J. (ed.) (ed.), Multicriteria Analysis. Springer, Cham, pp. 412-422. · Zbl 0896.90143
[41] Korhonen, P., Wallenius, J., 2008. Visualization in the multiple objective decision‐making framework. In Branke, J., Deb, K., Miettinen, K., Słowiński, R. (eds) Multiobjective Optimization. Springer, Cham, pp. 195-212.
[42] Lahtinen, T.J., Hämäläinen, R.P., Jenytin, C., 2020. On preference elicitation processes which mitigate the accumulation of biases in multi‐criteria decision analysis. European Journal of Operational Research282, 1, 201-210. · Zbl 1431.91112
[43] Lee, Y.‐H., Dunbar, N.E., Miller, C.H., Lane, B.L., Jensen, M.L., Bessarabova, E., Burgoon, J.K., Adame, B.J., Valacich, J.J., Adame, E.A., Bostwick, E., Piercy, C.W., Elizondo, J., Wilson, S. N., 2016. Training anchoring and representativeness bias mitigation through a digital game. Simulation & Gaming47, 6, 751-779.
[44] Lieder, F., Griffiths, T.L., Huys, Q.J., Goodman, N.D., 2018. The anchoring bias reflects the rational use of cognitive resources. Psychonomic Bulletin & Review25, 1, 322-349.
[45] Lin, S.‐W., 2013. An investigation of the range sensitivity of attribute weight in the analytic hierarchy process. Journal of Modelling in Management8, 1, 65-80.
[46] Liu, S., Cui, W., Wu, Y., Liu, M., 2014. A survey on information visualization: recent advances and challenges. The Visual Computer30, 12, 1373-1393.
[47] Lord, C.G., Lepper, M.R., Preston, E., 1984. Considering the opposite: a corrective strategy for social judgment. Journal of Personality and Social Psychology47, 6, 1231-1243.
[48] Lorko, M., Servátka, M., Zhang, L., 2019. Anchoring in project duration estimation. Journal of Economic Behavior & Organization162, 49-65.
[49] Marttunen, M., Belton, V., Lienert, J., 2018. Are objectives hierarchy‐related biases observed in practice? A meta‐analysis of environmental and energy applications of Multi‐Criteria Decision Analysis. European Journal of Operational Research265, 1, 178-194.
[50] McElroy, T., Dowd, K., 2007. Susceptibility to anchoring effects: how openness‐to‐experience influences responses to anchoring cues. Judgment and Decision Making2, 1, 48.
[51] Meub, L., Proeger, T., 2016. Can anchoring explain biased forecasts? Experimental evidence. Journal of Behavioral and Experimental Finance12, 1-13.
[52] Meub, L., Proeger, T., 2018. Are groups ‘less behavioral’? The case of anchoring. Theory and Decision85, 2, 117-150. · Zbl 1417.91168
[53] Meub, L., Proeger, T.E., 2015. Anchoring in social context. Journal of Behavioral and Experimental Economics55, 29-39.
[54] Miettinen, K., 2014. Survey of methods to visualize alternatives in multiple criteria decision making problems. OR Spectrum36, 1, 3-37. · Zbl 1290.91049
[55] Montibeller, G., 2018. Behavioral challenges in policy analysis with conflicting objectives. In Gel, E., Ntaimo, L. (eds) Recent Advances in Optimization and Modeling of Contemporary Problems. INFORMS, Catonsville, MD, pp. 85-108.
[56] Montibeller, G., vonWinterfeldt, D., 2015a. Biases and debiasing in multi‐criteria decision analysis. 2015 48th Hawaii International Conference on System Sciences, January 5—8, Kauai, HI, pp. 1218-1226.
[57] Montibeller, G., vonWinterfeldt, D., 2015b. Cognitive and motivational biases in decision and risk analysis. Risk Analysis35, 7, 1230-1251.
[58] Montibeller, G., vonWinterfeldt, D., 2018. Individual and group biases in value and uncertainty judgments. In Dias, L.C. (ed.), Morton, A. (ed.), Quigley, J. (ed.) (eds), Elicitation, Vol. 261. Springer, Cham, pp. 377-392.
[59] Mussweiler, T., Strack, F., 1999. Hypothesis‐consistent testing and semantic priming in the anchoring paradigm: a selective accessibility model. Journal of Experimental Social Psychology35, 2, 136-164.
[60] Mussweiler, T., Strack, F., Pfeiffer, T., 2000. Overcoming the inevitable anchoring effect: considering the opposite compensates for selective accessibility. Personality and Social Psychology Bulletin26, 9, 1142-1150.
[61] Petty, R.E., Cacioppo, J.T., 1986. Communication and Persuasion: Central and Peripheral Routes to Attitude Change. Springer‐Verlag, New York.
[62] Pines, J.M., Strong, A., 2019. Cognitive biases in emergency physicians: a pilot study. The Journal of Emergency Medicine27, 2, 168-172.
[63] Pöyhönen, M., Hämäläinen, R.P., 1998. Notes on the weighting biases in value trees. Journal of Behavioral Decision Making11, 2, 139-150.
[64] Pöyhönen, M., Hämäläinen, R.P., 2000. There is hope in attribute weighting. INFOR: Information Systems and Operational Research38, 3, 272-282. https://doi.org/10.1080/03155986.2000.11732412 · Zbl 07677621 · doi:10.1080/03155986.2000.11732412
[65] Pöyhönen, M., Hämäläinen, R.P., 2001. On the convergence of multiattribute weighting methods. European Journal of Operational Research129, 3, 569-585. · Zbl 1125.90368
[66] Pöyhönen, M., Vrolijk, H., Hämäläinen, R.P., 2001. Behavioral and procedural consequences of structural variation in value trees. European Journal of Operational Research134(1), 216-227. · Zbl 0993.90070
[67] Rezaei, J., 2015. Best‐worst multi‐criteria decision‐making method. Omega53, 49-57.
[68] Rezaei, J., 2016. Best‐worst multi‐criteria decision‐making method: some properties and a linear model. Omega64, 126-130. https://doi.org/10.1016/j.omega.2015.12.001 · doi:10.1016/j.omega.2015.12.001
[69] Rezaei, J., 2021. Anchoring bias in eliciting attribute weights and values in multi‐attribute decision making. Journal of Decision Systems30(1), 72-96.
[70] Rezaei, J., 2022. The balancing role of best and worst in best‐worst method. In Rezaei, J. (ed.), Brunelli, M. (ed.), Mohammadi, M. (ed.) (eds) Advances in Best‐Worst Method. Lecture Notes in Operations Research. Springer, Cham, pp. 1-15.
[71] Rezaei, J., Arab, A., Mehregan, M., 2022. Equalizing bias in eliciting attribute weights in multiattribute decision‐making: experimental research. Journal of Behavioral Decision Making35, 2, e2262.
[72] Riabacke, M., Danielson, M., Ekenberg, L., 2012. State‐of‐the‐art prescriptive criteria weight elicitation. Advances in Decision Sciences2012, 1-24.
[73] Richie, M., Josephson, S.A., 2018. Quantifying heuristic bias: anchoring, availability, and representativeness. Teaching and Learning in Medicine30, 1, 67-75.
[74] Shin, H., Park, S., 2018. Do foreign investors mitigate anchoring bias in stock market? Evidence based on post‐earnings announcement drift. Pacific‐Basin Finance Journal48, 224-240.
[75] Simon, H.A., 1957. Models of Man; Social and Rational. Wiley, Oxford, England. · Zbl 0082.35305
[76] Smith, A.R., Windschitl, P.D., 2015. Resisting anchoring effects: the roles of metric and mapping knowledge. Memory & Cognition43, 7, 1071-1084.
[77] Sniezek, J.A., 1992. Groups under uncertainty: an examination of confidence in group decision making. Organizational Behavior and Human Decision Processes52, 1, 124-155.
[78] Strack, F., Mussweiler, T., 1997. Explaining the enigmatic anchoring effect: mechanisms of selective accessibility. Journal of Personality and Social Psychology73, 3, 437-446.
[79] Thorsteinson, T.J., Breier, J., Atwell, A., Hamilton, C., Privette, M., 2008. Anchoring effects on performance judgments. Organizational Behavior and Human Decision Processes107, 1, 29-40.
[80] Triantaphyllou, E., 2000. Multi‐Criteria Decision Making Methods: A Comparative Study. Springer, Cham. · Zbl 0980.90032
[81] Tversky, A., Kahneman, D., 1974. Judgment under uncertainty: heuristics and biases. Science185, 4157, 1124-1131.
[82] Ünveren, B., Baycar, K., 2019. Historical evidence for anchoring bias: the 1875 cadastral survey in Istanbul. Journal of Economic Psychology73, 1-14.
[83] vanTil, J., Groothuis‐Oudshoorn, C., Lieferink, M., Dolan, J., Goetghebeur, M., 2014. Does technique matter; a pilot study exploring weighting techniques for a multi‐criteria decision support framework. Cost Effectiveness and Resource Allocation12, 1, 1-11.
[84] Vegas, S., Apa, C., Juristo, N., 2015. Crossover designs in software engineering experiments: benefits and perils. IEEE Transactions on Software Engineering42, 2, 120-135.
[85] vonNitzsch, R., Weber, M., 1993. The effect of attribute ranges on weights in multiattribute utility measurements. Management Science39, 8, 937-943. · Zbl 0800.90071
[86] vonWinterfeldt, D., Edwards, W., 1986. Decision Analysis and Behavioral Research. Cambridge University Press, Cambridge.
[87] Wachowicz, T., Kersten, G.E., Roszkowska, E., 2019. How do I tell you what I want? Agent’s interpretation of principal’s preferences and its impact on understanding the negotiation process and outcomes. Operational Research19, 4, 993-1032.
[88] Wallenius, J., 1975. Comparative evaluation of some interactive approaches to multicriterion optimization. Management Science21, 12, 1387-1396. · Zbl 0307.90084
[89] Wattanacharoensil, W., La‐ornual, D., 2019. A systematic review of cognitive biases in tourist decisions. Tourism Management75, 353-369.
[90] Weber, M., Borcherding, K., 1993. Behavioral influences on weight judgments in multiattribute decision making. European Journal of Operational Research67, 1, 1-12.
[91] Weber, M., Eisenführ, F., vonWinterfeldt, D., 1988. The effects of splitting attributes on weights in multiattribute utility measurement. Management Science34, 4, 431-445.
[92] Wegener, D.T., Petty, R.E., Detweiler‐Bedell, B.T., Jarvis, W.B.G., 2001. Implications of attitude change theories for numerical anchoring: anchor plausibility and the limits of anchor effectiveness. Journal of Experimental Social Psychology37, 1, 62-69.
[93] Welsh, M.B., Delfabbro, P.H., Burns, N.R., Begg, S.H., 2014. Individual differences in anchoring: traits and experience. Learning and Individual Differences29, 131-140.
[94] Wilson, T.D., Houston, C.E., Etling, K.M., Brekke, N., 1996. A new look at anchoring effects: basic anchoring and its antecedents. Journal of Experimental Psychology: General125, 4, 387-402.
[95] Wright, W.F., Anderson, U., 1989. Effects of situation familiarity and financial incentives on use of the anchoring and adjustment heuristic for probability assessment. Organizational Behavior and Human Decision Processes44, 1, 68-82.
[96] Yik, M., Wong, K.F.E., Zeng, K.J., 2019. Anchoring and adjustment during affect inferences. Frontiers in Psychology9, 2567.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.