Abstract
It is often argued that usability problems should be identified as early as possible during software development, but many usability evaluation methods do not fit well in early development activities. We propose a method for usability evaluation of use cases, a widely used representation of design ideas produced early in software development processes. The method proceeds by systematic inspection of use cases with reference to a set of guidelines for usable design. To validate the method, four evaluators inspected a set of use cases for a health care application. The usability problems predicted by the evaluators were compared to the result of a conventional think-aloud test. About one fourth of the problems were identified by both think-aloud testing and use case inspection; about half of the predicted problems not found by think-aloud testing were assessed as providing useful input to early development. Qualitative data on the evaluators’ experience using the method are also presented. On this background, we argue that use case inspection has a promising potential and discuss its limitations.
Chapter PDF
Similar content being viewed by others
References
Anda, B., Sjøberg, D.I.: Towards an inspection technique for use case models. In: Proceedings of the 14th international Conference on Software Engineering and Knowledge Engineering, pp. 127–134 (2002)
Anderson, J., Fleek, F., Garrity, K., Drake, F.: Integrating Usability Techniques into Software Development. IEEE Software 18(1), 46–53 (2001)
Bittner, K., Spence, I.: Use case modeling. Addison-Wesley, Reading (2002)
Carroll, J.: Scenario-based design - envisioning work and technology in system development. John Wiley & Sons, Chichester (1995)
Cockburn, A.: Writing effective use cases. Addison-Wesley, Reading (2000)
Cockburn, A.: Use cases, ten years later (March/April 2002)
Cockton, G., Lavery, D., Woolrych, A.: Inspection-based evaluations. In: Jacko, J.A., Sears, A. (eds.) The human-computer interaction handbook, pp. 1118–1138 (2003)
Cockton, G., Woolrych, A., Hall, L., Hindmarch, M.: Changing Analysts’ Tunes. In: Proceedings of People and Computers XVII: Designing for Society, pp. 145–162 (2003)
Cockton, G., Woolrych, A., Hindemarch, M.: Reconditioned merchandise: extended structured report formats in usability inspection. In: Proceedings of CHI 2004, pp. 1433–1436 (2004)
Constantine, L., Lockwood, L.: Software for Use: A Practical Guide to the Models and Methods of Usage-Centered Design. Addison-Wesley, Reading (1999)
Dumas, J.S.: User-based Evaluations. In: Jacko, J.A., Sears, A. (eds.) The human-computer interaction handbook, pp. 1093–1117 (2003)
Ferré, X., Jurisot, N., Windl, H., Constantine, L.: Usability Basics for Software Developers. IEEE Software 18(1), 22–29 (2001)
Green, T.R.G.: Cognitive Dimensions of Notations. In: Proceedings of People and Computers V, pp. 443-460 (1989)
Haynes, S.R., Purao, S., Skattebo, A.L.: Situating evaluation in scenarios of use. In: Proceedings of CSCW 2004, pp. 92–101 (2004)
Hertzum, M.: Making use of scenarios: a field study of conceptual design. International Journal of Human-Computer Studies 58(2), 215–239 (2003)
Hertzum, M., Jacobsen, N.E.: The evaluator effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction 13, 421–443 (2001)
Holtblatt, K., Wendell, J.B., Wood, S.: Rapid contextual design. Morgan Kaufman, San Francisco (2005)
Hornbæk, K., Stage, J.: The Interplay Between Usability Evaluation and User Interaction Design. International Journal of Human Computer Interaction 21(2), 117–123 (2006)
Hornbæk, K., Frøkjær, E.: Two psychology-based usability inspection techniques studied in a diary experiment. In: Proceedings of Nordichi 2004, pp. 1–8 (2004)
Jacobson, I.: Object oriented development in an industrial environment. In: Proceedings of OOPSLA 1987, pp. 183–191. ACM, New York (1987)
Jacobson, I., Booch, G., Rumbaugh, J.: The unified software development process. Addison-Weley, Boston (1999)
Jagielska, D., Wenick, P., Wood, M., Bennett, S.: How Natural is Natural Language? How Well do Computer Science Students Write Use Cases? In: Proceedings of OOPSLA 2006, pp. 914–923 (2006)
Jarke, M., Bui, X.T., Carroll, J.: Scenario management: an interdisciplinary approach. Requirements Engineering 3(3&4), 155–173 (1998)
John, B.E., Mashyna, M.M.: Evaluating a Multimedia Authoring Tool. Journal of the American Society of Information Science 48(9), 1004–1022 (1997)
John, B.E., Marks, S.J.: Tracking the effectiveness of usability evaluation methods. Behaviour & Information Technology 16(4/5), 188–202 (1997)
Juristo, N., Windl, H., Constantine, L.: Introducing usability. IEEE Software, 20–21 (2001)
Kjeldskov, J., Skov, M., Stage, J.: Instant Data Analysis. In: Proceedings of the third Nordic conference on Human-computer interaction, pp. 233–240 (2004)
Larman, C.: Applying uml and patterns: an introduction to object-oriented analysis and design. Prentice Hall, Upper Saddle River (1998)
Molich, R.: brugervenligt webdesign. Nyt Teknisk Forlag (2005)
Molich, R., Nielsen, J.: improving a human-computer dialogue. Communications of the ACM 33(3), 338–348 (1990)
Nielsen, J.: Heuristic Evaluation. In: Nielsen, J., Mack, R. (eds.) usability inspection methods, pp. 25–62. John Wiley & Sons, Chichester (1994)
Nielsen, J., Landauer, T.: A mathematical model of the finding of usability problems. In: Proceedings of CHI 1993, pp. 206–213 (1993)
Nørgaard, M., Hornbæk, K.: What Do Usability Evaluators Do in Practice? An Explorative Study of Think-Aloud Testing. In: Proceedings of DIS 2006 (2006)
Scapin, D.L., Bastien, J.M.C.: Ergonomic Criteria for Evaluating the Ergonomic Quality of Interactive Systems. Behaviour & Information Technology 16(4/5), 220–231 (1997)
Seffah, A., Djouab, R., Antunes, H.: Comparing and reconciling usability-centered and use case-driven requirements engineering processes. In: Proceedings of the 2nd Australasian conference on User interface, pp. 132–139 (2001)
Straus, A., Corbett, J.: Basics of qualitative research. Sage, Thousand Oaks (1998)
Tao, Y.: Developing Usable GUI Applications with Early Usability Evaluation. In: Proceedings of Proceedings: Software Engineering - 2005 (2005)
van der Poll, J.A., Kotzé, P., Seffah, A., Radhakrishnan, T., Alsumait, A.: Combining UCMs and Formal Methods for Representing and Checking the Validity of Scenarios as User Requirements. In: Proceedings of SAICSIT 2003, pp. 59–68 (2003)
Walker, M., Takayama, L., Landay, J.A.: High-fidelity or Low Fidelity, Paper or Computer? In: Proceedings of HFES 2002, pp. 661–665 (2002)
Wharton, C., Rieman, J., Lewis, C., Polson, P.: The cognitive walkthrough method: a practitioner’s guide. In: Nielsen, J., Mack, R.L. (eds.) Usability inspection methods, pp. 105–140. John Wiley & Sons, Chichester (1994)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 IFIP International Federation for Information Processing
About this paper
Cite this paper
Hornbæk, K., Høegh, R.T., Pedersen, M.B., Stage, J. (2007). Use Case Evaluation (UCE): A Method for Early Usability Evaluation in Software Development. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds) Human-Computer Interaction – INTERACT 2007. INTERACT 2007. Lecture Notes in Computer Science, vol 4662. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74796-3_58
Download citation
DOI: https://doi.org/10.1007/978-3-540-74796-3_58
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74794-9
Online ISBN: 978-3-540-74796-3
eBook Packages: Computer ScienceComputer Science (R0)