A simple weighting scheme for classification in two-group discriminant problems. (English) Zbl 1118.90310
Summary: This paper introduces a new weighted linear programming model, which is simple and has strong intuitive appeal for two-group classifications. Generally, in applying weights to solve a classification problem in discriminant analysis where the relative importance of every observation is known, larger weights (penalties) will be assigned to those more important observations. The perceived importance of an observation is measured here as the willingness of the decision-maker to misclassify this observation. For instance, a decision-maker is least willing to see a classification rule that misclassifies a top financially strong firm to the group that contains bankrupt firms. Our weighted-linear programming model provides an objective-weighting scheme whereby observations can be weighted according to their perceived importance. The more important this observation, the heavier its assigned weight. Results of a simulation experiment that uses contaminated data show that the weighted linear programming model consistently and significantly outperforms existing linear programming and standard statistical approaches in attaining higher average hit-ratios in the 100 replications for each of the 27 cases tested.
MSC:
| 90C05 | Linear programming |
| 62H30 | Classification and discrimination; cluster analysis (statistical aspects) |
References:
| [1] | Huberty, C. J., Issues in the use and interpretation of discriminant analysis, Psychological Bulletin, 95, 156-171 (1984) |
| [2] | Joachimsthaler, E. A.; Stam, A., Mathematical programming approaches for the classification problem in two-group discriminant problem, Multivariate Behavioral Research, 25, 427-457 (1990) |
| [3] | Fisher, R. A., The use of multiple measurements in taxonomic problems, Annals of Eugenics, 7, 179-188 (1936) |
| [4] | Bajgier, S. M.; Hill, A. V., An experimental comparison of statistical and linear programming approaches to the discriminant problem, Decision Sciences, 13, 604-618 (1982) |
| [5] | Freed, N.; Glover, F., Evaluating alternative linear programming models to solve the two-group discriminant problem, Decision Sciences, 17, 151-162 (1986) |
| [6] | Joachimsthaler, E. A.; Stam, A., Four approaches to the classification problem in discriminant analysis: an experimental study, Decision Sciences, 19, 322-333 (1988) |
| [7] | Lam, K. F.; Moy, J. W., An experimental comparison of some recently developed linear programming approaches to the discriminant problem, Journal of Computers and Operations Research, 24, 593-599 (1997) · Zbl 0882.90098 |
| [8] | Freed, N.; Glover, F., Simple but powerful goal programming models for discriminant problems, European Journal of Operational Research, 7, 44-66 (1981) · Zbl 0456.90075 |
| [9] | Koehler, G. J., Considerations for mathematical programming models in discriminant analysis, Managerial and Decision Economics, 11, 227-234 (1990) |
| [10] | Erenguc, S. S.; Koehler, G. J., Survey of mathematical programming models and experimental results for linear discriminant analysis, Managerial and Decision Economics, 11, 215-225 (1990) |
| [11] | Stam, A., Nontraditional approaches to statistical classification: some perspectives on \(L_p\)-norm methods, Annals of Operations Research, 74, 1-36 (1997) · Zbl 0888.90161 |
| [12] | Markowski, E. P.; Markowski, C. A., An experimental comparison of several approaches to the discriminant problem with both qualitative and quantitative variables, European Journal of Operational Research, 28, 74-78 (1987) |
| [13] | Banks, W. J.; Abad, P. L., On the performance of linear programming heuristics applied on a quadratic transformation in the classification problem, European Journal of Operational Research, 74, 23-28 (1994) · Zbl 0798.90132 |
| [14] | Freed, N.; Glover, F., Resolving certain difficulties and improving the classification power of LP discriminant analysis formulations, Decision Sciences, 17, 589-595 (1986) |
| [15] | Glover, F., Improved linear programming models for discriminant analysis, Decision Sciences, 21, 771-785 (1990) |
| [16] | Lam, K. F.; Choo, E. U.; Moy, J. W., Minimizing deviations from the group mean: a new linear programming approach for the two-group classification problem, European Journal of Operational Research, 88, 358-367 (1996) · Zbl 0913.90271 |
| [17] | Glorfeld LW, Kattan MW. A comparison of the performance of three classification procedures when applied to contaminated data. Proceedings of the 21st Annual Meeting of the Decision Sciences Institute, New Orleans, Louisiana, 1989. p. 1153-55.; Glorfeld LW, Kattan MW. A comparison of the performance of three classification procedures when applied to contaminated data. Proceedings of the 21st Annual Meeting of the Decision Sciences Institute, New Orleans, Louisiana, 1989. p. 1153-55. |
| [18] | Hample, F. R.; Ronchetti, E. M.; Rousseeuw, P. J.; Stahel, W. A., Robust statistics: the approach based on influence functions (1986), Wiley: Wiley New York · Zbl 0593.62027 |
| [19] | Stam, A.; Ragsdale, C. T., On the classification gap in MP-based approaches to the discriminant problem, Naval Research Logistics, 39, 545-559 (1992) · Zbl 0743.62054 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
