×

Static resource allocation for heterogeneous computing environments with tasks having dependencies, priorities, deadlines, and multiple versions. (English) Zbl 1243.68049

Summary: Heterogeneous computing (HC) environments composed of interconnected machines with varied computational capabilities are well suited to meet the computational demands of large, diverse groups of tasks. One aspect of resource allocation in HC environments is matching tasks with machines and scheduling task execution on the assigned machines. We will refer to this matching and scheduling process as mapping. The problem of mapping these tasks onto the machines of a distributed HC environment has been shown, in general, to be NP-complete. Therefore, the development of heuristic techniques to find near-optimal solutions is required. In the HC environment investigated, tasks have deadlines, priorities, multiple versions, and may be composed of communicating subtasks. The best static (off-line) techniques from some previous studies are adapted and applied to this mapping problem: a genetic algorithm (GA), a GENITOR-style algorithm, and a two phase greedy technique based on the concept of min-min heuristics. Simulation studies compare the performance of these heuristics in several overloaded scenarios, i.e., not all tasks can be executed by their deadlines. The performance measure used is the sum of weighted priorities of tasks that completed before their deadline, adjusted based on the version of the task used. It is shown that for the cases studied here, the GENITOR technique finds the best results, but the faster two phase greedy approach also performs very well.

MSC:

68M14 Distributed systems
68M20 Performance evaluation, queueing, and scheduling in the context of computer systems
90C59 Approximation methods and heuristics in mathematical programming

Software:

Tabu search; Genocop
Full Text: DOI

References:

[1] Ali, S.; Braun, T. D.; Siegel, H. J.; Maciejewski, A. A.; Beck, N.; Boloni, L.; Maheswaran, M.; Reuther, A. I.; Robertson, J. P.; Theys, M. D.; Yao, B.: Characterizing resource allocation heuristics for heterogeneous computing systems, Advances in computers volume 63: parallel, distributed, and pervasive computing, 91-128 (2005)
[2] Ali, S.; Maciejewski, A. A.; Siegel, H. J.; Kim, J. -K.: Measuring the robustness of a resource allocation, IEEE transactions on parallel and distributed systems 15, No. 7, 630-641 (2004)
[3] Ali, S.; Siegel, H. J.; Maheswaran, M.; Hensgen, D.; Ali, S.: Representing task and machine heterogeneities for heterogeneous computing systems, Tamkang journal of science and engineering 3, No. 3, 195-207 (2000)
[4] R. Armstrong, D. Hensgen, T. Kidd, The relative performance of various mapping algorithms is independent of sizable variances in run-time predictions, in: 7th IEEE Heterogeneous Computing Workshop (HCW ’98), Mar. 1998, pp. 79–87
[5] Attiya, G.; Hamam, Y.: Task allocation for maximizing reliability of distributed systems: A simulated annealing approach, Journal of parallel and distributed computing 66, No. 10, 1259-1266 (2006) · Zbl 1102.68399 · doi:10.1016/j.jpdc.2006.06.006
[6] J.E. Baker, Reducing bias and inefficiency in the selection algorithm, in: J.J. Grefenstette, ed., 2nd International Conference on Genetic Algorithms, July 1987, pp. 14–21
[7] I. Banicescu, V. Velusamy, Performance of scheduling scientific applications with adaptive weighted factoring, 10th IEEE Heterogeneous Computing Workshop (HCW 2001), in: Proceedings of 15th International Parallel and Distributed Processing Symposium (IPDPS 2001), Apr. 2001
[8] H. Barada, S.M. Sait, N. Baig, Task matching and scheduling in heterogeneous systems using simulated evolution, 10th IEEE Heterogeneous Computing Workshop (HCW 2001), in: Proceedings of 15th International Parallel and Distributed Processing Symposium (IPDPS 2001), Apr. 2001
[9] Braun, T. D.; Siegel, H. J.; Beck, N.; Bölöni, L. L.; Maheswaran, M.; Reuther, A. I.; Robertson, J. P.; Theys, M. D.; Yao, B.; Hensgen, D.; Freund, R. F.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems, Journal of parallel and distributed computing 61, No. 6, 810-837 (2001) · Zbl 0990.68013 · doi:10.1006/jpdc.2000.1714
[10] , Computer and job-shop scheduling theory (1976) · Zbl 0359.90031
[11] L. Davis, Applying adaptive algorithms to epistatic domains, in: 9th International Joint Conference on Artificial Intelligence, Aug. 1985, pp. 162–164
[12] K.A. DeJong, An Analysis of the Behavior of a Class of Genetic Adaptive Systems, doctoral dissertation, Dept. of Computer and Communication Sciences, University of Michigan, Ann Arbor, MI, 1975
[13] Dhodhi, M. K.; Ahmad, I.; Ahmad, I.; Yatama, A.: An integrated technique for task matching and scheduling onto distributed heterogeneous computing systems, Journal of parallel and distributed computing 62, No. 9, 1338-1361 (2002) · Zbl 1063.68021 · doi:10.1006/jpdc.2002.1850
[14] Doğan, A.; Özgüner, F.: Scheduling of a meta-task with QoS requirements in heterogeneous computing systems, Journal of parallel and distributed computing 66, No. 2, 181-196 (2006) · Zbl 1158.68326 · doi:10.1016/j.jpdc.2005.07.004
[15] , Heterogeneous computing (1996)
[16] Foster, I.; Kesselman, C.: The grid: blueprint for a new computing infrastructure, (2004)
[17] R.F. Freund, M. Gherrity, S. Ambrosius, M. Campbell, M. Halderman, D. Hensgen, E. Keith, T. Kidd, M. Kussow, J.D. Lima, F. Mirabile, L. Moore, B. Rust, H.J. Siegel, Scheduling resources in multi-user, heterogeneous, computing environments with SmartNet, in: 7th IEEE Heterogeneous Computing Workshop (HCW ’98), Mar. 1998, pp. 184–199
[18] Freund, R. F.; Siegel, H. J.: Heterogeneous processing, IEEE computer 26, No. 6 (1993)
[19] Ghafoor, A.; Yang, J.: Distributed heterogeneous supercomputing management system, IEEE computer 26, No. 6, 78-86 (1993)
[20] Glover, F.; Laguna, M.: Tabu search, (1997) · Zbl 0930.90083
[21] D.A. Hensgen, T. Kidd, M.C. Schnaidt, D.St. John, H.J. Siegel, T.D. Braun, M. Maheswaran, S. Ali, J.-K. Kim, C. Irvine, T. Levin, R. Wright, R.F. Freund, M. Godfrey, A. Duman, P. Carff, S. Kidd, V. Prasanna, P. Bhat, A. Alhusaini, An overview of MSHN: A management system for heterogeneous networks, in: 8th IEEE Workshop on Heterogeneous Computing Systems (HCW ’99), Apr. 1999, pp. 184–198
[22] Holland, J. H.: Adaptation in natural and artificial systems, (1975) · Zbl 0317.68006
[23] E.-N. Huh, L.R. Welch, B.A. Shirazi, C.D. Cavanaugh, Heterogeneous resource management for dynamic real-time systems, in: 9th IEEE Heterogeneous Computing Workshop (HCW 2000), May 2000, pp. 287–294
[24] Ibarra, O. H.; Kim, C. E.: Heuristic algorithms for scheduling independent tasks on nonidentical processors, Journal of the ACM 24, No. 2, 280-289 (1977) · Zbl 0382.90048 · doi:10.1145/322003.322011
[25] Jain, R.: The art of computer systems performance analysis techniques for experimental design, measurement, simulation, and modeling, (1991) · Zbl 0824.68013
[26] Kafil, M.; Ahmad, I.: Optimal task assignment in heterogeneous distributed computing systems, IEEE concurrency 6, No. 3, 42-51 (1998)
[27] Samee Ullah Khan, Ishfaq Ahmad, Non-cooperative, semi-cooperative, and cooperative games-based grid resource allocation, in: 20th IEEE International Parallel and Distributed Processing Symposium, March 2006 · Zbl 1243.68040
[28] Khokhar, A. A.; Prasanna, V. K.; Shaaban, M. E.; Wang, C. L.: Heterogeneous computing: challenges and opportunities, IEEE computer 26, No. 6, 18-27 (1993)
[29] Kirkpatrick, S.; Jr., C. D. Gelatt; Vecchi, M. P.: Optimization by simulated annealing, Science 220, No. 4598, 671-680 (1983) · Zbl 1225.90162 · doi:10.1126/science.220.4598.671
[30] Kim, J. -K.; Hensgen, D. A.; Kidd, T.; Siegel, H. J.; John, D. St.; Irvine, C.; Levin, T.; Porter, N. W.; Prasanna, V. K.; Freund, R. F.: A flexible multi- dimensional QoS performance measure framework for distributed heterogeneous systems, Cluster computing 9, No. 3, 281-296 (2006)
[31] Kim, J. -K.; Shivle, S.; Siegel, H. J.; Maciejewski, A. A.; Braun, T. D.; Schneider, M.; Tideman, S.; Chitta, R.; Dilmaghani, R. B.; Joshi, R.; Kaul, A.; Sharma, A.; Sripada, S.; Vangari, P.; Yellampalli, S. S.: Dynamically mapping tasks with priorities and multiple deadlines in a heterogeneous environment, Journal of parallel and distributed computing 67, No. 2, 154-169 (2007) · Zbl 1158.68327 · doi:10.1016/j.jpdc.2006.06.005
[32] Kwok, Y. -K.; Maciejewski, A. A.; Siegel, H. J.; Ahmad, I.; Ghafoor, A.: A semi-static approach to mapping dynamic iterative tasks onto heterogeneous computing systems, Journal of parallel and distributed computing 66, No. 1, 77-98 (2006) · Zbl 1158.68540 · doi:10.1016/j.jpdc.2005.06.015
[33] Maheswaran, M.; Ali, S.; Siegel, H. J.; Hensgen, D.; Freund, R. F.: Dynamic mapping of a class of independent tasks onto heterogeneous computing systems, Journal of parallel and distributed computing 59, No. 2, 107-121 (1999)
[34] Maheswaran, M.; Braun, T. D.; Siegel, H. J.: Heterogeneous distributed computing, Encyclopedia of electrical and electronics engineering 8, 679-690 (1999)
[35] Michalewicz, Z.: Genetic algorithms + data structures = evolution programs, (1996) · Zbl 0841.68047
[36] Michalewicz, Z.; Fogel, D. B.: How to solve it: modern heuristics, (2004) · Zbl 1058.68105
[37] A. Pavan, V. Gopal, S. Song, N. Birch, R. Harinath, D. Castanon, Admission control and resource allocation in a strictly priority based network, in: International Conference on Real-Time Computing Systems and Applications, Dec. 2000, pp. 231–238
[38] Qin, X.; Jiang, H.: A dynamic and reliability-driven scheduling algorithm for parallel real-time jobs executing on heterogeneous clusters, Journal of parallel and distributed computing 65, No. 8, 885-900 (2005) · Zbl 1082.68523 · doi:10.1016/j.jpdc.2005.02.003
[39] Russell, S. J.; Norvig, P.: Artificial intelligence: A modern approach, (2003) · Zbl 0835.68093
[40] V. Shestak, H.J. Siegel, Anthony A. Maciejewski, S. Ali, Robust resource allocations in parallel computing systems: Model and heuristics, in: 8th International Symposium on Parallel Architectures, Algorithms, and Networks (I-SPAN 2005), Dec. 2005. Invited
[41] Shilve, S.; Siegel, H. J.; Maciejewski, A. A.; Sugavanam, P.; Banka, T.; Castain, R.; Chindam, K.; Dussinger, S.; Pichumani, P.; Satyasekaran, P.; Saylor, W.; Sendek, D.; Sousa, J.; Sridharan, J.; Velazco, J.: Static allocation of resources to communicating subtasks in a heterogeneous ad hoc grid environment, Journal of parallel and distributed computing 66, No. 4, 600-611 (2006) · Zbl 1095.68012 · doi:10.1016/j.jpdc.2005.10.005
[42] Shen, C. -C.; Tsai, W. -H.: A graph matching approach to optimal task assignment in distributed computing system using a minimax criterion, IEEE transactions on computers 34, No. 3, 197-203 (1985)
[43] P. Shroff, D. Watson, N. Flann, R. Freund, Genetic simulated annealing for scheduling data-dependent tasks in heterogeneous environments, in: 5th IEEE Heterogeneous Computing Workshop (HCW ’96), Apr. 1996, pp. 98–104
[44] Siegel, H. J.; Dietz, H. G.; Antonio, J. K.: Software support for heterogeneous computing, The computer science and engineering handbook, 1886-1909 (1997)
[45] H. Singh, A. Youssef, Mapping and scheduling heterogeneous task graphs using genetic algorithms, in: 5th IEEE Heterogeneous Computing Workshop (HCW ’96), Apr. 1996, pp. 86–97
[46] Srinivas, M.; Patnaik, L. M.: Genetic algorithms: A survey, IEEE computer 27, No. 6, 17-26 (1994)
[47] Syswerda, G.: Uniform crossover in genetic algorithms, 3rd international conference on genetic algorithms, 2-9 (1989)
[48] Syswerda, G.: Schedule optimization using genetic algorithms, Handbook of genetic algorithms, 332-349 (1991)
[49] Theys, M. D.; Beck, N.; Siegel, H. J.; Jurczyk, M.: An analysis of procedures and objective functions for heuristics to perform data staging in distributed systems, Journal of interconnection networks 7, No. 2, 257-293 (2006)
[50] Theys, M. D.; Tan, M.; Beck, N. B.; Siegel, H. J.; Jurczyk, M.: A mathematical model and scheduling heuristics for satisfying prioritized data requests in an oversubscribed communication network, IEEE transactions on parallel and distributed systems 11, No. 9, 969-988 (2000)
[51] Wang, I. -J.; Jones, S. D.: Agile information control environment program, Johns hopkins APL technical digest 20, No. 3, 271-275 (1999)
[52] Watson, J. -P.; Rana, S.; Whitley, L. D.; Howe, A. E.: The impact of approximate evaluation on the performance of search algorithms for warehouse scheduling, Journal of scheduling 2, No. 2, 79-98 (1999) · Zbl 0973.90036 · doi:10.1002/(SICI)1099-1425(199903/04)2:2<79::AID-JOS19>3.0.CO;2-H
[53] Wang, L.; Siegel, H. J.; Roychowdhury, V. P.; Maciejewski, A. A.: Task matching and scheduling in heterogeneous computing environments using a genetic-algorithm-based approach, Journal of parallel and distributed computing 47, No. 1, 8-22 (1997)
[54] L.R. Welch, P.V. Werme, L.A. Fontenot, M.W. Masters, B.A. Shirazi, B. Ravindran, D.W. Mills, Adaptive QoS and resource panagement using a posteriori workload characterizations, in: 5th IEEE Real-Time Technology and Applications Symp., 1999, pp. 266–275
[55] Whitley, D.: The GENITOR algorithm and selective pressure: why rank-based allocation of reproductive trials is best, 3rd international conference on genetic algorithms, 116-121 (1989)
[56] M.-Y. Wu, W. Shu, H. Zhang, Segmented Min–Min: A static mapping algorithm for meta-tasks on heterogeneous computing systems, in: 9th IEEE Heterogeneous Computing Workshop (HCW 2000), May 2000, pp. 375–385
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.