×

The magic of logical inference in probabilistic programming. (English) Zbl 1222.68060

Summary: Today, there exist many different probabilistic programming languages as well as more inference mechanisms for these languages. Still, most logic programming-based languages use backward reasoning based on selective linear definite resolution for inference. While these methods are typically computationally efficient, they often can neither handle infinite and/or continuous distributions nor evidence. To overcome these limitations, we introduce distributional clauses, a variation and extension of Sato’s distribution semantics. We also contribute a novel approximate inference method that integrates forward reasoning with importance sampling, a well-known technique for probabilistic inference. In order to achieve efficiency, we integrate two logic programming techniques to direct forward sampling. Magic sets are used to focus on relevant parts of the program, while the integration of backward reasoning allows one to identify and avoid regions of the sample space that are inconsistent with the evidence.

MSC:

68N17 Logic programming
68Q55 Semantics in the theory of computing

Software:

ProbLog; Church; IBAL

References:

[1] Wasserman, All of Statistics: A Concise Course in Statistical Inference (Springer Texts in Statistics) (2003) · Zbl 1053.62005
[2] De Raedt, Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI) pp 2462– (2007)
[3] Milch, Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics, January 6–8, Barbados pp 238– (2005)
[4] Milch, Proceedings of THE Nineteenth International Joint Conference on Artificial Intelligence (IJCAI) pp 1352– (2005)
[5] De Raedt, Proceedings of the 1st Workshop on Probabilistic Programming: Universal Languages, Systems and Applications (2008)
[6] Mantadelis, Technical Communications of the 26th International Conference on Logic Programming (ICLP-10) pp 124– (2010)
[7] Baral, Theory and Practice of Logic Programming 9 pp 1– (2009)
[8] Koller, Probabilistic Graphical Models: Principles and Techniques (2009) · Zbl 1183.68483
[9] Gutmann, Proceedings of the 20th International Conference on Inductive Logic Programming (ILP–10) (2010)
[10] Goodman, Proceedings of the 24th Conference in Uncertainty in Artificial Intelligence pp 220– (2008)
[11] Sato, Journal of Artificial Intelligence Resesearch (JAIR) 15 pp 391– (2001)
[12] Sato, Proceedings of the Twelth International Conference on Logic Programming (ICLP 1995) pp 715– (1995)
[13] Getoor, An Introduction to Statistical Relational Learning (2007)
[14] Eisner, Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP-05) pp 6– (2005)
[15] Nilsson, Logic, Programming And Prolog (1996)
[16] Pfeffer, Seventeenth International Joint Conference on Artificial Intelligence pp 733– (2001)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.