×

Inconsistent heuristics in theory and practice. (English) Zbl 1225.68244

Summary: In the field of heuristic search it is usually assumed that admissible heuristics are consistent, implying that consistency is a desirable attribute. The term “inconsistent heuristic” has, at times, been portrayed negatively, as something to be avoided. Part of this is historical: early research discovered that inconsistency can lead to poor performance for \(A^{*}\) (nodes might be re-expanded many times). However, the issue has never been fully investigated, and was not re-considered after the invention of \(IDA^{*}\).
This paper shows that many of the preconceived notions about inconsistent heuristics are outdated. The worst-case exponential time of inconsistent heuristics is shown to only occur on contrived graphs with edge weights that are exponential in the size of the graph. Furthermore, the paper shows that rather than being something to be avoided, inconsistent heuristics often add a diversity of heuristic values into a search which can lead to a reduction in the number of node expansions. Inconsistent heuristics are easy to create, contrary to the common perception in the AI literature. To demonstrate this, a number of methods for achieving effective inconsistent heuristics are presented.
Pathmax is a way of propagating inconsistent heuristic values in the search from parent to children. This technique is generalized into bidirectional pathmax (BPMX) which propagates values from a parent to a child node, and vice versa. BPMX can be integrated into \(IDA^{*}\) and \(A^{*}\). When inconsistent heuristics are used with BPMX, experimental results show a large reduction in the search effort required by \(IDA^{*}\). Positive results are also presented for \(A^{\ast}\) searches.

MSC:

68T20 Problem solving in the context of artificial intelligence (heuristics, search strategies, etc.)
Full Text: DOI

References:

[1] Bagchi, A.; Mahanti, A., Search algorithms under different kinds of heuristics—A comparative study, Journal of the ACM, 30, 1, 1-21 (1983) · Zbl 0497.68035
[2] M. Ball, R.C. Holte, The compression power of symbolic pattern databases, in: International Conference on Automated Planning and Scheduling (ICAPS-08), 2008, pp. 2-11.; M. Ball, R.C. Holte, The compression power of symbolic pattern databases, in: International Conference on Automated Planning and Scheduling (ICAPS-08), 2008, pp. 2-11.
[3] B. Bonet, H. Geffner, Learning depth-first search: A unified approach to heuristic search in deterministic and non-deterministic settings, and its application to MDPs, in: International Conference on Automated Planning and Scheduling (ICAPS-06), 2006, pp. 142-151.; B. Bonet, H. Geffner, Learning depth-first search: A unified approach to heuristic search in deterministic and non-deterministic settings, and its application to MDPs, in: International Conference on Automated Planning and Scheduling (ICAPS-06), 2006, pp. 142-151.
[4] Chen, T.; Skiena, S., Sorting with fixed-length reversals, Discrete Applied Mathematics, 71, 1-3, 269-295 (1996) · Zbl 0870.68052
[5] Culberson, J. C.; Schaeffer, J., Pattern databases, Computational Intelligence, 14, 3, 318-334 (1998)
[6] Dechter, R.; Pearl, J., Generalized best-first search strategies and the optimality of \(A^⁎\), Journal of the ACM, 32, 3, 505-536 (1985) · Zbl 0631.68075
[7] C. Domshlak, E. Karpas, S. Markovitch, To max or not to max: Online learning for speeding up optimal planning, in: AAAI Conference on Artificial Intelligence (AAAI-10), 2010, pp. 1701-1706.; C. Domshlak, E. Karpas, S. Markovitch, To max or not to max: Online learning for speeding up optimal planning, in: AAAI Conference on Artificial Intelligence (AAAI-10), 2010, pp. 1701-1706.
[8] Dweighter, H., Problem e2569, American Mathematical Monthly, 82, 1010 (1975)
[9] S. Edelkamp, Planning with pattern databases, in: European Conference on Planning (ECP-01), 2001, pp. 13-24.; S. Edelkamp, Planning with pattern databases, in: European Conference on Planning (ECP-01), 2001, pp. 13-24.
[10] Felner, A.; Korf, R. E.; Hanan, S., Additive pattern database heuristics, Journal of Artificial Intelligence Research, 22, 279-318 (2004) · Zbl 1080.68662
[11] Felner, A.; Korf, R. E.; Meshulam, R.; Holte, R. C., Compressed pattern databases, Journal of Artificial Intelligence Research, 30, 213-247 (2007) · Zbl 1182.68071
[12] A. Felner, R. Meshulam, R.C. Holte, R.E. Korf, Compressing pattern databases, in: National Conference on Artificial Intelligence (AAAI-04), 2004, pp. 638-643.; A. Felner, R. Meshulam, R.C. Holte, R.E. Korf, Compressing pattern databases, in: National Conference on Artificial Intelligence (AAAI-04), 2004, pp. 638-643. · Zbl 1182.68071
[13] A. Felner, N. Sturtevant, J. Schaeffer, Abstraction-based heuristics with true distance computations, in: Symposium on Abstraction, Reformulation and Approximation (SARA-09), 2009.; A. Felner, N. Sturtevant, J. Schaeffer, Abstraction-based heuristics with true distance computations, in: Symposium on Abstraction, Reformulation and Approximation (SARA-09), 2009.
[14] A. Felner, U. Zahavi, J. Schaeffer, R.C. Holte, Dual lookups in pattern databases, in: International Joint Conference on Artificial Intelligence (IJCAI-05), 2005, pp. 103-108.; A. Felner, U. Zahavi, J. Schaeffer, R.C. Holte, Dual lookups in pattern databases, in: International Joint Conference on Artificial Intelligence (IJCAI-05), 2005, pp. 103-108.
[15] Hart, P. E.; Nilsson, N. J.; Raphael, B., A formal basis for the heuristic determination of minimum cost paths, IEEE Transactions on Systems Science and Cybernetics, SCC-4, 2, 100-107 (1968)
[16] M. Helmert, Landmark heuristics for the pancake problem, in: Third Annual Symposium on Combinatorial Search (SOCS-10), 2010, pp. 109-110.; M. Helmert, Landmark heuristics for the pancake problem, in: Third Annual Symposium on Combinatorial Search (SOCS-10), 2010, pp. 109-110.
[17] Helmert, Malte; Röger, Gabriele, Relative-order abstractions for the pancake problem, (ECAI (2010)), 745-750 · Zbl 1211.68381
[18] Holte, R. C.; Felner, A.; Newton, J.; Meshulam, R.; Furcy, D., Maximizing over multiple pattern databases speeds up heuristic search, Artificial Intelligence, 170, 1123-1136 (2006) · Zbl 1130.68323
[19] R.C. Holte, J. Newton, A. Felner, R. Meshulam, D. Furcy, Multiple pattern databases, in: International Conference on Automated Planning and Scheduling (ICAPS-04), 2004, pp. 122-131.; R.C. Holte, J. Newton, A. Felner, R. Meshulam, D. Furcy, Multiple pattern databases, in: International Conference on Automated Planning and Scheduling (ICAPS-04), 2004, pp. 122-131.
[20] R.C. Holte, M.B. Perez, R.M. Zimmer, A.J. MacDonald, Hierarchical \(A^⁎\); R.C. Holte, M.B. Perez, R.M. Zimmer, A.J. MacDonald, Hierarchical \(A^⁎\)
[21] A. Junghanns, J. Schaeffer, Domain-dependent single-agent search enhancements, in: International Joint Conference on Artificial Intelligence (IJCAI-99), 1999, pp. 570-575.; A. Junghanns, J. Schaeffer, Domain-dependent single-agent search enhancements, in: International Joint Conference on Artificial Intelligence (IJCAI-99), 1999, pp. 570-575.
[22] Korf, R. E., Depth-first iterative-deepening: An optimal admissible tree search, Artificial Intelligence, 27, 1, 97-109 (1985) · Zbl 0573.68030
[23] Korf, R. E., Real-time heuristic search, Artificial Intelligence, 42, 3, 189-211 (1990) · Zbl 0718.68082
[24] R.E. Korf, Finding optimal solutions to Rubikʼs Cube using pattern databases, in: National Conference on Artificial Intelligence (AAAI-97), 1997, pp. 700-705.; R.E. Korf, Finding optimal solutions to Rubikʼs Cube using pattern databases, in: National Conference on Artificial Intelligence (AAAI-97), 1997, pp. 700-705.
[25] R.E. Korf, Recent progress in the design and analysis of admissible heuristic functions, in: National Conference on Artificial Intelligence (AAAI-00), 2000, pp. 1165-1170.; R.E. Korf, Recent progress in the design and analysis of admissible heuristic functions, in: National Conference on Artificial Intelligence (AAAI-00), 2000, pp. 1165-1170.
[26] Korf, R. E.; Felner, A., Disjoint pattern database heuristics, Artificial Intelligence, 134, 1-2, 9-22 (2002) · Zbl 0992.68190
[27] R.E. Korf, A. Felner, Recent progress in heuristic search: A case study of the four-peg Towers of Hanoi problem, in: International Joint Conference on Artificial Intelligence (IJCAI-07), 2007, pp. 2324-2329.; R.E. Korf, A. Felner, Recent progress in heuristic search: A case study of the four-peg Towers of Hanoi problem, in: International Joint Conference on Artificial Intelligence (IJCAI-07), 2007, pp. 2324-2329.
[28] R.E. Korf, M. Reid, Complexity analysis of admissible heuristic search, in: National Conference on Artificial Intelligence (AAAI-98), 1998, pp. 305-310.; R.E. Korf, M. Reid, Complexity analysis of admissible heuristic search, in: National Conference on Artificial Intelligence (AAAI-98), 1998, pp. 305-310.
[29] Korf, R. E.; Reid, M.; Edelkamp, S., Time complexity of iterative-deepening-\(A^⁎\), Artificial Intelligence, 129, 1-2, 199-218 (2001) · Zbl 0971.68147
[30] Korf, R. E.; Zhang, W.; Thayer, I.; Hohwald, H., Frontier search, Journal of the ACM, 52, 5, 715-748 (September 2005) · Zbl 1323.68466
[31] Mahanti, A.; Ghosh, S.; Nau, D.; Pal, A.; Kanal, L., On the asymptotic performance of \(IDA^⁎\), Annals of Mathematics and Artificial Intelligence, 20, 1-4, 161-193 (1997) · Zbl 0887.68018
[32] Martelli, A., On the complexity of admissible search algorithms, Artificial Intelligence, 8, 1, 1-13 (1977) · Zbl 0344.68023
[33] M. McNaughton, P. Lu, J. Schaeffer, D. Szafron, Memory efficient \(A^⁎\); M. McNaughton, P. Lu, J. Schaeffer, D. Szafron, Memory efficient \(A^⁎\)
[34] Mero, L., A heuristic search algorithm with modifiable estimate, Artificial Intelligence, 23, 13-27 (1984) · Zbl 0537.68063
[35] Nilsson, N., Artificial Intelligence: A New Synthesis (1998), Morgan Kaufmann · Zbl 1012.68605
[36] Pearl, J., Heuristics: Intelligent Search Strategies for Computer Problem Solving (1984), Addison-Wesley
[37] D. Ratner, M.K. Warmuth, Finding a shortest solution for the N; D. Ratner, M.K. Warmuth, Finding a shortest solution for the N
[38] Russell, S.; Norvig, P., Artificial Intelligence, A Modern Approach (2010), Prentice-Hall
[39] M. Samadi, M. Siabani, A. Felner, R.C. Holte, Compressing pattern databases using learning, in: European Conference on Artificial Intelligence (ECAI-08), 2008, pp. 495-499.; M. Samadi, M. Siabani, A. Felner, R.C. Holte, Compressing pattern databases using learning, in: European Conference on Artificial Intelligence (ECAI-08), 2008, pp. 495-499.
[40] N. Sturtevant, A. Felner, M. Barer, J. Schaeffer, N. Burch, Memory-based heuristics for explicit state spaces, in: International Joint Conference on Artificial Intelligence (IJCAI-09), 2009, pp. 609-614.; N. Sturtevant, A. Felner, M. Barer, J. Schaeffer, N. Burch, Memory-based heuristics for explicit state spaces, in: International Joint Conference on Artificial Intelligence (IJCAI-09), 2009, pp. 609-614.
[41] Yang, F.; Culberson, J.; Holte, R. C.; Zahavi, U.; Felner, A., A general theory of additive state space abstractions, Journal of Artificial Intelligence Research, 32, 631-662 (2008) · Zbl 1182.68078
[42] U. Zahavi, A. Felner, N. Burch, R.C. Holte, Predicting the performance of \(IDA^⁎\); U. Zahavi, A. Felner, N. Burch, R.C. Holte, Predicting the performance of \(IDA^⁎\) · Zbl 1185.68287
[43] Zahavi, U.; Felner, A.; Burch, N.; Holte, R. C., Predicting the performance of \(IDA^⁎\) (with BPMX) with conditional distributions, Journal of Artificial Intelligence Research, 37, 41-83 (2010) · Zbl 1185.68287
[44] U. Zahavi, A. Felner, R.C. Holte, J. Schaeffer, Dual search in permutation state spaces, in: National Conference on Artificial Intelligence (AAAI-06), 2006, pp. 1076-1081.; U. Zahavi, A. Felner, R.C. Holte, J. Schaeffer, Dual search in permutation state spaces, in: National Conference on Artificial Intelligence (AAAI-06), 2006, pp. 1076-1081. · Zbl 1182.68273
[45] Zahavi, U.; Felner, A.; Holte, R. C.; Schaeffer, J., Duality in permutation state spaces and the dual search algorithm, Artificial Intelligence, 172, 4-5, 514-540 (2008) · Zbl 1182.68273
[46] U. Zahavi, A. Felner, J. Schaeffer, N.R. Sturtevant, Inconsistent heuristics, in: National Conference on Artificial Intelligence (AAAI-07), 2007, pp. 1211-1216.; U. Zahavi, A. Felner, J. Schaeffer, N.R. Sturtevant, Inconsistent heuristics, in: National Conference on Artificial Intelligence (AAAI-07), 2007, pp. 1211-1216.
[47] Z. Zhang, N. Sturtevant, J. Schaeffer, R.C. Holte, A. Felner, \(A^⁎\); Z. Zhang, N. Sturtevant, J. Schaeffer, R.C. Holte, A. Felner, \(A^⁎\)
[48] R. Zhou, E. Hansen, Space-efficient memory-based heuristics, in: National Conference on Artificial Intelligence (AAAI-04), 2004, pp. 677-682.; R. Zhou, E. Hansen, Space-efficient memory-based heuristics, in: National Conference on Artificial Intelligence (AAAI-04), 2004, pp. 677-682.
[49] Zhou, R.; Hansen, E., Breadth-first heuristic search, Artificial Intelligence, 170, 4-5, 385-408 (2006) · Zbl 1131.68101
[50] R. Zhou, E.A. Hansen, Memory-bounded \(A^⁎\); R. Zhou, E.A. Hansen, Memory-bounded \(A^⁎\)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.