skip to main content
article
Free access

On stability and performance of parallel processing systems

Published: 01 April 1991 Publication History

Abstract

The general problem of parallel (concurrent) processing is investigated from a queuing theoretic point of view.
As a basic simple model, consider infinitely many processors that can work simultaneously, and a stream of arriving jobs, each carrying a processing time requirement. Upon arrival, a job is allocated to a processor and starts being executed, unless it is blocked by another one already in the system. Indeed, any job can be randomly blocked by any preceding one, in the sense that it cannot start being processed before the one that blocks it leaves. After execution, the job leaves the system. The arrival times, the processing times and the blocking structures of the jobs form a stationary and ergodic sequence.
The random precedence constraints capture the essential operational characteristic of parallel processing and allow a unified treatment of concurrent processing systems from such diverse areas as parallel computation, database concurrency control, queuing networks, flexible manufacturing systems. The above basic model includes the G/G/1 and G/G/∞ queuing systems as special extreme cases.
Although there is an infinite number of processors, the precedence constraints induce a queuing phenomenon, which, depending on the loading conditions, can lead to stability or instability of the system.
In this paper, the condition for stability of the system is first precisely specified. The asymptotic behavior, at large times, of the quantities associated with the performance of the system is then studied, and the degree of parallelism, expressed as the asymptotic average number of processors that work concurrently, is computed. Finally, various design and simulation aspects concerning parallel processing systems are considered, and the case of finite number of processors is discussed.
The results proved for the basic model are then extended to cover more complex and realistic parallel processing systems, where each job has a random internal structure of subtasks to be executed according to some internal precedence constriants.

References

[1]
BACCELLI, F., AND BREMAUD, P. Paim probabilities and stationary queues. In Lecture Notes in Statisncs. vol 41. Sprmger-Verlag, New York, 1987.
[2]
BACCELLI, F., AND LIU, Z On the stability condmon of a precedence-based queuelng discipline Res. Rep No 880. INRIA Sophia Antipolls, France, July 1988.
[3]
FRANKEN, P, KOFNIG, D., ARNDT, U., AND SCHMIDT, V Verlag, Berhn, Germany, 1982. Queues and point processes Akademle
[4]
KINGMAN, J. F. C. The ergodic theory of subadditlve stochasnc processes. J. Roy. Statist. Soc., Ser. B 30 (1968), 499-510.
[5]
KINGMAN, J. F. C. Subaddmve ergo&c theory. Annals Prob. 1, 6 (1973), 883-909
[6]
KINGMAN, J. F. C Subaddiuve processes Ecole d'Ete de Probabitite de Salnt-Flour, V-1975. In P. L. Hennequln, Ed. Lecture Notes in Mathemattcs, vol. 539. Sprmger-Verlag, New York
[7]
LOYNES, R. M. The stab~llty of a queue with non-independent rater-arrival and service times Proc. Cambridge Philosophzcal Soc., 58 (1962), 497-520.
[8]
MATTHES, K, KERSTAN, J., 4ND MECKE, J.Infinitely Divzszble Point Processes. Akademle Verlag, Berlin, 1978.
[9]
PAPADIMITRIOU, C. The Theoo' of Database Concurrency Control. Computer Science Press, New York, 1986.
[10]
TSITSIKLIS, J., PAPADIMITRIOU, C., ~ND HUMBLET, P. The performance of a precedence-based queuing &scipline J. A CM 33, 3 (July 1986), 593-602.
[11]
WALRAND, J.An Introduction to Queuing Networks. Prentace Hail, New York, 1988
[12]
WALTERS, P. An lntroductlon to Ergodic Theory. Sprlnger-Verlag, New York, 1982.

Cited By

View all
  • (2017)Robust scheduling for flexible processing networksAdvances in Applied Probability10.1017/apr.2017.1449:02(603-628)Online publication date: 26-Jun-2017
  • (2016)Scheduling and stability aspects of a general class of parallel processing systemsAdvances in Applied Probability10.2307/142750125:1(176-202)Online publication date: 1-Jul-2016
  • (2016)On the stability of a batch clearing system with Poisson arrivals and subadditive service timesJournal of Applied Probability10.1239/jap/100509102738:3(621-634)Online publication date: 14-Jul-2016
  • Show More Cited By

Recommendations

Reviews

David Karl Probst

Following Tsitsiklis and Papadimitriou [1], the authors use queueing theory to investigate the stability and performance of parallel processing systems, assuming that precedence constraints among job executions are their most essential characteristic. A basic model of systems with an infinite number of processors is developed, in which the input process N also defines a set of random precedences on jobs. The basic model, in contrast to earlier work, assumes only stationaryness and ergodicity of the input. The parallel traffic intensity &ggr;, defined by the authors as a particular functional of the input N , allows them to specify the stability condition of the system. In theorem 1, the stability condition is shown to be &ggr; < 1. A disconcerting misprint occurs here; the instability condition should read &ggr; > 1. The asymptotic behavior of a number of performance measures is studied, including completion time, workload, processor number (that is, the number of active processors), and waiting time. In stable parallel processing systems, define the degree of parallelism &pgr; as the expected number of active processors in the stationary state. Theorem 4 shows this to be equal to the (ordinary) traffic intensity &rgr;. In Section 5, the need for a good statistical estimator of the parallel traffic intensity &ggr; is pointed out. Also, since only a finite number of processors of stable systems are active in the stationary state, this provides a bridge to more realistic models with a finite number of processors. The methods of this paper, which investigate how queueing phenomena arising from precedence constraints limit the full use of all the processors, may shed light on choosing the number of processors required for good performance. Section 6 studies more complex models, including one motivated by two-phase locking. In Section 8 (the conclusion), the authors argue that the “essentially qualitative nature” of their methods allows them to be applied to a broad range of queueing and processing systems.

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image Journal of the ACM
Journal of the ACM  Volume 38, Issue 2
April 1991
260 pages
ISSN:0004-5411
EISSN:1557-735X
DOI:10.1145/103516
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 1991
Published in JACM Volume 38, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. database concurrency control
  2. parallel processing
  3. queueing networks
  4. queueing theory
  5. stability theory
  6. subadditive ergodic theory

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)24
  • Downloads (Last 6 weeks)3
Reflects downloads up to 22 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2017)Robust scheduling for flexible processing networksAdvances in Applied Probability10.1017/apr.2017.1449:02(603-628)Online publication date: 26-Jun-2017
  • (2016)Scheduling and stability aspects of a general class of parallel processing systemsAdvances in Applied Probability10.2307/142750125:1(176-202)Online publication date: 1-Jul-2016
  • (2016)On the stability of a batch clearing system with Poisson arrivals and subadditive service timesJournal of Applied Probability10.1239/jap/100509102738:3(621-634)Online publication date: 14-Jul-2016
  • (2016)On the stability of a batch clearing system with Poisson arrivals and subadditive service timesJournal of Applied Probability10.1017/S002190020001879938:03(621-634)Online publication date: 14-Jul-2016
  • (2014)Robust scheduling in a flexible fork-join network53rd IEEE Conference on Decision and Control10.1109/CDC.2014.7039960(3669-3676)Online publication date: Dec-2014
  • (2014)Scheduling tasks with precedence constraints on multiple servers2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton)10.1109/ALLERTON.2014.7028591(1196-1203)Online publication date: Sep-2014
  • (2009)Optimality Aspects of Greedy Schemes in Parallel Processing of Random Graph-Structured JobsProbability in the Engineering and Informational Sciences10.1017/S02699648000033758:02(229)Online publication date: 27-Jul-2009
  • (2000)Allocation of interdependent resources for maximal throughputCommunications in Statistics. Stochastic Models10.1080/1532634000880757516:1(27-48)Online publication date: Jan-2000
  • (1994)On pathwise behavior of multiserver queuesQueueing Systems10.1007/BF0118924115:1-4(279-288)Online publication date: Mar-1994
  • (1994)On the stability of queueing systems under precedence restrictions for the service of customersQueueing Systems10.1007/BF0115868917:1-2(73-88)Online publication date: Mar-1994
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media