×

Maintenance goals of agents in a dynamic environment: formulation and policy construction. (English) Zbl 1183.68630

Summary: The notion of maintenance often appears in the AI literature in the context of agent behavior and planning. In this paper, we argue that earlier characterizations of the notion of maintenance are not intuitive to characterize the maintenance behavior of certain agents in a dynamic environment. We propose a different characterization of maintenance and distinguish it from earlier notions such as stabilizability. Our notion of maintenance is more sensitive to a good-natured agent which struggles with an “adversary” environment, which hinders her by unforeseeable events to reach her goals (not in principle, but in case). It has a parameter \(k\), referring to the length of non-interference (from exogenous events) needed to maintain a goal; we refer to this notion as \(k\)-maintainability. We demonstrate the notion on examples, and address the important but non-trivial issue of efficient construction of maintainability control functions. We present an algorithm which in polynomial time constructs a \(k\)-maintainable control function, if one exists, or tells that no such control is possible. Our algorithm is based on SAT Solving, and employs a suitable formulation of the existence of \(k\)-maintainable control in a fragment of SAT which is tractable. For small \(k\) (bounded by a constant), our algorithm is linear time. We then give a logic programming implementation of our algorithm and use it to give a standard procedural algorithm, and analyze the complexity of constructing \(k\)-maintainable controls, under different assumptions such as \(k=1\), and states described by variables. On the one hand, our work provides new concepts and algorithms for maintenance in dynamic environment, and on the other hand, a very fruitful application of computational logic tools. We compare our work with earlier works on control synthesis from temporal logic specification and relate our work to Dijkstra’s notion of self-stabilization and related notions in distributed computing.

MSC:

68T42 Agent technology and artificial intelligence

Software:

Smodels
Full Text: DOI

References:

[1] Abadi, M.; Lamport, L.; Wolper, P., Realizable and unrealizable specifications of reactive systems, (Proc. 16th International Conference on Automata, Languages, and Programming (ICALP 89). Proc. 16th International Conference on Automata, Languages, and Programming (ICALP 89), LNCS, vol. 372 (1989), Springer), 1-17
[2] Arora, A.; Gouda, M. G., Closure and convergence: A foundation of fault-tolerant computing, IEEE Transactions on Software Engineering, 19, 11, 1015-1027 (1993)
[3] Bacchus, F.; Kabanza, F., Planning for temporally extended goals, Annals of Mathematics and Artificial Intelligence, 22, 5-27 (1998) · Zbl 1034.68549
[4] Baral, C.; Eiter, T.; Zhao, J., Using SAT and LP to design polynomial-time algorithms for planning in non-deterministic domains, (Proc. 20th National Conference on Artificial Intelligence (AAAI ’05) (2005), AAAI Press), 578-583
[5] Baral, C.; Gelfond, M.; Provetti, A., Representing actions: Laws, observations, and hypothesis, Journal of Logic Programming, 31, 201-243 (1997) · Zbl 0882.68030
[6] Baral, C.; Kreinovich, V.; Trejo, R., Computational complexity of planning and approximate planning in the presence of incompleteness, Artificial Intelligence, 122, 1-2, 241-267 (2000) · Zbl 0948.68088
[7] Baral, C.; Kreinovich, V.; Trejo, R., Computational complexity of planning with temporal goals, (Nebel, B., Proc. 17th International Joint Conference on Artificial Intelligence (IJCAI-01) (2001), Morgan Kaufmann), 509-514
[8] Baral, C.; Son, T., Relating theories of actions and reactive control, Electronic Transactions on Artificial Intelligence, 2, 3-4, 211-271 (1998)
[9] Baral, C.; Zhao, J., Goal specification in presence of non-deterministic actions, (de Mántaras, R. L.; Saitta, L., Proc. 16th European Conference on Artificial Intelligence (ECAI 2004) (2004), IOS Press), 273-277
[10] M. Barbeau, F. Kabanza, R. St-Denis, Synthesizing plan controllers using real-time goals, in: Proc. 14th International Joint Conference on Artificial Intelligence (IJCAI-95), 1995, pp. 791-800; M. Barbeau, F. Kabanza, R. St-Denis, Synthesizing plan controllers using real-time goals, in: Proc. 14th International Joint Conference on Artificial Intelligence (IJCAI-95), 1995, pp. 791-800
[11] Barrington, D.; Immerman, N.; Straubing, H., On uniformity within \(N C^1\), Journal of Computer and System Sciences, 41, 274-306 (1990) · Zbl 0719.68023
[12] M. Ben-Ari, Z. Manna, A. Puneli, The temporal logic of branching time, in: Proc. 8th Symposium on Principles of Programming Languages, 1981, pp. 164-176; M. Ben-Ari, Z. Manna, A. Puneli, The temporal logic of branching time, in: Proc. 8th Symposium on Principles of Programming Languages, 1981, pp. 164-176
[13] P. Bertoli, A. Cimatti, M. Pistore, Strong cyclic planning under partial observability, in: ECAI, 2006, pp. 580-584; P. Bertoli, A. Cimatti, M. Pistore, Strong cyclic planning under partial observability, in: ECAI, 2006, pp. 580-584
[14] P. Bertoli, M. Pistore, Planning with extended goals and partial observability, in: S. Zilberstein, J. Koehler, S. Koenig (Eds.), ICAPS, 2004, pp. 270-278; P. Bertoli, M. Pistore, Planning with extended goals and partial observability, in: S. Zilberstein, J. Koehler, S. Koenig (Eds.), ICAPS, 2004, pp. 270-278
[15] Brooks, R., A robust layered control system for a mobile robot, IEEE Journal of Robotics and Automation, 2, 1, 14-23 (1986)
[16] Bylander, T., The computational complexity of propositional strips planning, Artificial Intelligence, 69, 165-204 (1994) · Zbl 0821.68065
[17] S. Ceri, J. Widom, Deriving production rules for constraint maintenance, in: P.M.G. Apers, G. Wiederhold (Eds.), Proc. 15th International Conference on Very Large Data Bases (VLDB-90), 1990, pp. 566-577; S. Ceri, J. Widom, Deriving production rules for constraint maintenance, in: P.M.G. Apers, G. Wiederhold (Eds.), Proc. 15th International Conference on Very Large Data Bases (VLDB-90), 1990, pp. 566-577
[18] Cimatti, A.; Pistore, M.; Roveri, M.; Traverso, P., Weak, strong, and strong cyclic planning via symbolic model checking, Artificial Intelligence, 147, 1-2, 35-84 (2003) · Zbl 1082.68800
[19] Clarke, E.; Emerson, E., Design and synthesis of synchronization skeletons using branching-time temporal logic, (Proc. Workshop on Logic of Programs. Proc. Workshop on Logic of Programs, LNCS, vol. 131 (1981), Springer), 52-71 · Zbl 0546.68014
[20] Clarke, E.; Emerson, E.; Sistla, A., Automatic verification of finite-state concurrent systems using temporal logic specifications, ACM Transactions on Programming Languages and Systems, 8, 2, 244-263 (1986) · Zbl 0591.68027
[21] Daniele, M.; Traverso, P.; Vardi, M., Strong cyclic planning revisited, (Proc. 5th European Conference on Planning (ECP’99). Proc. 5th European Conference on Planning (ECP’99), LNCS/LNAI, vol. 1809 (1999), Springer), 35-48
[22] Dantsin, E.; Eiter, T.; Gottlob, G.; Voronkov, A., Complexity and expressive power of logic programming, ACM Computing Surveys, 33, 3, 374-425 (2001)
[23] G. De Giacomo, R. Reiter, M. Soutchanski, Execution monitoring of high-level robot programs, in: Proc. Sixth Conference on Principles of Knowledge Representation and Reasoning (KR-98), 1998, pp. 453-465; G. De Giacomo, R. Reiter, M. Soutchanski, Execution monitoring of high-level robot programs, in: Proc. Sixth Conference on Principles of Knowledge Representation and Reasoning (KR-98), 1998, pp. 453-465
[24] Dijkstra, E. W., Self-stabilizing systems in spite of distributed control, CACM, 17, 11, 644-843 (1974) · Zbl 0305.68048
[25] Dowling, W.; Gallier, J. H., Linear-time algorithms for testing the satisfiability of propositional Horn theories, Journal of Logic Programming, 3, 267-284 (1984) · Zbl 0593.68062
[26] M. Drummond, Situation control rules, in: Proc. First International Conference on Principles of Knowledge Representation and Reasoning (KR-89), 1989, pp. 103-113; M. Drummond, Situation control rules, in: Proc. First International Conference on Principles of Knowledge Representation and Reasoning (KR-89), 1989, pp. 103-113 · Zbl 0709.68049
[27] Dunne, P.; Laurence, M.; Wooldridge, M., Complexity results for agent design problems, Annals of Mathematics, Computing & Teleinformatics, 1, 1, 19-36 (2003)
[28] Dunne, P.; Wooldridge, M., Optimistic and disjunctive agent design problems, (Castelfranchi, C.; Lespérance, Y., Proc. 7th International Workshop on Intelligent Agents (ATAL VII). Proc. 7th International Workshop on Intelligent Agents (ATAL VII), LNCS, vol. 1986 (2001), Springer), 1-14 · Zbl 1056.68575
[29] Eiter, T.; Faber, W.; Leone, N.; Pfeifer, G., Declarative problem-solving using the DLV system, (Minker, J., Logic-Based Artificial Intelligence (2000), Kluwer), 79-103 · Zbl 0979.68091
[30] Emerson, E., Temporal and modal logics, (van, J., Handbook of Theoretical Computer Science, vol. B (1990), Elsevier), Chapter 16 · Zbl 0900.03030
[31] Erol, K.; Subrahmanian, V.; Nau, D., Complexity, decidability and undecidability results for domain-independent planning, Artificial Intelligence, 76, 75-88 (1995) · Zbl 1013.68548
[32] Fikes, R. E.; Nilsson, N. J., Strips: A new approach to the application of theorem proving to problem solving, Artificial Intelligence, 2, 3-4, 189-208 (1971) · Zbl 0234.68036
[33] Gelfond, M.; Lifschitz, V., Classical negation in logic programs and disjunctive databases, New Generation Computing, 9, 365-385 (1991) · Zbl 0735.68012
[34] Gelfond, M.; Lifschitz, V., Representing action in extended logic programs, (Proc. Joint International Conference and Symposium on Logic Programming (JICSLP’92) (1992), MIT Press), 559-573
[35] Ghallab, M.; Nau, D.; Traverso, P., Automated Planning—Theory and Practice (2004), Morgan Kaufmann · Zbl 1074.68613
[36] Ginsberg, M. L., Universal planning: An (almost) universally bad idea, AI Magazine, 10, 4, 40-44 (1989)
[37] Harding, A.; Ryan, M.; Schobbens, P.-Y., A new algorithm for strategy synthesis in ltl games, (Halbwachs, N.; Zuck, L. D., TACAS. TACAS, LNCS, vol. 3440 (2005), Springer), 477-492 · Zbl 1087.68020
[38] Immerman, N., Descriptive Complexity (1999), Springer · Zbl 0918.68031
[39] R.M. Jensen, M.M. Veloso, M.H. Bowling, OBDD-based optimistic and strong cyclic adversarial planning, in: Proc. 6th European Conference on Planning (ECP-01), 2001; R.M. Jensen, M.M. Veloso, M.H. Bowling, OBDD-based optimistic and strong cyclic adversarial planning, in: Proc. 6th European Conference on Planning (ECP-01), 2001
[40] R.M. Jensen, M.M. Veloso, R.E. Bryant, Fault tolerant planning: Toward probabilistic uncertainty models in symbolic non-deterministic planning, in: S. Zilberstein, J. Koehler, S. Koenig (Eds.), Proc. 14th International Conference on Automated Planning and Scheduling (ICAPS 2004), 2004, pp. 335-344; R.M. Jensen, M.M. Veloso, R.E. Bryant, Fault tolerant planning: Toward probabilistic uncertainty models in symbolic non-deterministic planning, in: S. Zilberstein, J. Koehler, S. Koenig (Eds.), Proc. 14th International Conference on Automated Planning and Scheduling (ICAPS 2004), 2004, pp. 335-344
[41] Kabanza, F.; Barbeau, M.; St-Denis, R., Planning control rules for reactive agents, Artificial Intelligence, 95, 1, 67-113 (1997) · Zbl 0894.68138
[42] L.P. Kaelbling, S.J. Rosenschein, Action and planning in embedded agents, in: Maes [47]; L.P. Kaelbling, S.J. Rosenschein, Action and planning in embedded agents, in: Maes [47]
[43] Kuratowski, C., Topology I (1966), Academic Press: Academic Press New York · Zbl 0158.40901
[44] U.D. Lago, M. Pistore, P. Traverso, Planning with a language for extended goals, in: AAAI/IAAI, 2002, pp. 447-454; U.D. Lago, M. Pistore, P. Traverso, Planning with a language for extended goals, in: AAAI/IAAI, 2002, pp. 447-454
[45] Leone, N.; Pfeifer, G.; Faber, W.; Eiter, T.; Gottlob, G.; Perri, S.; Scarcello, F., The DLV system for knowledge representation and reasoning, ACM Transactions on Computational Logic, 7, 3, 499-562 (2006) · Zbl 1367.68308
[46] M.L. Littman, Probabilistic propositional planning: Representations and complexity, in: Proc. 14th National Conference on Artificial Intelligence and 9th Innovative Applications of Artificial Intelligence Conference (AAAI/IAAI 1997), 1997, pp. 748-754; M.L. Littman, Probabilistic propositional planning: Representations and complexity, in: Proc. 14th National Conference on Artificial Intelligence and 9th Innovative Applications of Artificial Intelligence Conference (AAAI/IAAI 1997), 1997, pp. 748-754
[47] (Maes, P., Designing Autonomous Agents: Theory and Practice from Biology to Engineering and Back (1990), MIT Press)
[48] Manna, Z.; Pnueli, A., The Temporal Logic of Reactive and Concurrent Systems Specification (1992), Springer
[49] Manna, Z.; Wolper, P., Synthesis of communicating processes from temporal logic specifications, ACM Transactions on Programming Languages and Systems, 6, 1, 68-93 (1984) · Zbl 0522.68030
[50] Minoux, M., LTUR: A simplified linear time unit resolution for Horn formulae and computer implementation, Information Processing Letters, 29, 1-12 (1988) · Zbl 0658.68110
[51] Nakamura, M.; Baral, C., Invariance, maintenance and other declarative objectives of triggers—a formal characterization of active databases, (Lloyd, J., Proc. First International Conference on Computational Logic (CL 2000). Proc. First International Conference on Computational Logic (CL 2000), LNAI, vol. 1861 (2000), Springer), 1210-1224 · Zbl 0983.68742
[52] Nakamura, M.; Baral, C.; Bjæreland, M., Maintainability: A weaker stabilizability like notion for high level control, (Proc. 17th National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence (AAAI/IAAI 2000) (2000), AAAI Press), 62-67
[53] Niemelä, I.; Simons, P.; Syrjänen, T., Smodels: A system for answer set programming, (Baral, C.; Truszczyński, M., Proc. 8th International Workshop on Non-Monotonic Reasoning (NMR’2000) (2000)), available at
[54] Niyogi, R.; Sarkar, S., Logical specification of goals, (Ghosh, R. K.; Misra, D., Proc. 3rd International Conference on Information Technology (CIT 2001) (2000), Tata McGraw-Hill), 77-82
[55] Ortiz, C., A commonsense language for reasoning about causation and rational action, Artificial Intelligence, 111, 2, 73-130 (1999) · Zbl 0996.68190
[56] Ozveren, O.; Willsky, A.; Antsaklis, P., Stability and stabilizability of discrete event dynamic systems, Journal of ACM, 38, 3, 730-752 (1991) · Zbl 0812.93002
[57] Papadimitriou, C. H., Computational Complexity (1994), Addison-Wesley · Zbl 0557.68033
[58] Passino, K.; Burgess, K., Stability Analysis of Discrete Event Systems (1998), John Wiley and Sons
[59] N. Piterman, A. Pnueli, Y. Sa’ar, Synthesis of reactive(1) designs, in: VMCAI, 2006, pp. 364-380; N. Piterman, A. Pnueli, Y. Sa’ar, Synthesis of reactive(1) designs, in: VMCAI, 2006, pp. 364-380 · Zbl 1176.68126
[60] A. Pnueli, R. Rosner, On the synthesis of a reactive module, in: Proc. 16th Annual ACM Symposium on Principles of Programming Languages (POPL 1989), 1989, pp. 179-190; A. Pnueli, R. Rosner, On the synthesis of a reactive module, in: Proc. 16th Annual ACM Symposium on Principles of Programming Languages (POPL 1989), 1989, pp. 179-190 · Zbl 0686.68015
[61] Ramadge, P.; Wonham, W., Modular feedback logic for discrete event systems, SIAM Journal of Control and Optimization, 25, 5, 1202-1217 (1987) · Zbl 0694.93037
[62] Ramadge, P.; Wonham, W., Supervisory control of a class of discrete event process, SIAM Journal of Control and Optimization, 25, 1, 206-230 (1987) · Zbl 0618.93033
[63] Reiter, R., Knowledge in Action: Logical Foundation for Describing and Implementing Dynamical Systems (2001), MIT Press · Zbl 1018.03022
[64] J. Rintanen, Complexity of planning with partial observability, in: S. Zilberstein, J. Koehler, S. Koenig, (Eds.), Proc. 14th International Conference on Automated Planning and Scheduling (ICAPS 2004), 2004, pp. 345-354; J. Rintanen, Complexity of planning with partial observability, in: S. Zilberstein, J. Koehler, S. Koenig, (Eds.), Proc. 14th International Conference on Automated Planning and Scheduling (ICAPS 2004), 2004, pp. 345-354
[65] Simons, P.; Niemelä, I.; Soininen, T., Extending and implementing the stable model semantics, Artificial Intelligence, 138, 181-234 (2002) · Zbl 0995.68021
[66] Sontag, E., Stability and stabilization: Discontinuities and the effect of disturbances, (Clarke, F.; Stern, R., Proc. NATO Advanced Study Institute (1998), Kluwer), 551-598 · Zbl 0937.93034
[67] Weld, D.; Etzioni, O., The first law of robotics (a call to arms), (Proc. Twelfth National Conference on Artificial Intelligence (AAAI-94) (1994), AAAI Press), 1042-1047
[68] (Widom, J.; Ceri, S., Active Database Systems: Triggers and Rules For Advanced Database Processing (1996), Morgan Kaufmann)
[69] Wooldridge, M., The computational complexity of agent design problems, (Proc. Fourth International Conference on Multi-Agent Systems (ICMAS 2000) (2000), IEEE Press), 341-348
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.