Skip to main content

Evaluating the Usefulness of Visual Features for Supporting Document Triage

  • Conference paper
  • First Online:
Research and Advanced Technology for Digital Libraries (TPDL 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10450))

Included in the following conference series:

Abstract

One of many challenges the users of digital libraries face is the quick and easy identification of relevant documents as well as their effective use – a process which is called document triage. While there is a variety of means for supporting the actual search process in digital libraries, only few address document triage. In this paper, we investigate the usefulness of user initiated support features that might assist users in this process. Therefore, we implemented SortBoard, a visual workspace for assisting document triage in a digital library for the social sciences. The results of a user study with 16 participants show that the features are highly useful for comparing and organizing documents as well as finding and examining similarities between documents.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
eBook
USD 39.99
Price excludes VAT (USA)
Softcover Book
USD 54.99
Price excludes VAT (USA)

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://sowiport.gesis.org/.

  2. 2.

    http://sowiport.gesis.org/.

References

  1. Bae, S., Kim, D., Meintanis, K., Moore, J.M., Zacchi, A., Shipman, F., Hsieh, H., Marshall, C.C.: Supporting document triage via annotation-based multi-application visualizations. In: Proceedings of the 10th Annual Joint Conference on Digital Libraries, pp. 177���186. ACM (2010)

    Google Scholar 

  2. Bae, S., Marshall, C.C., Meintanis, K., Zacchi, A., Hsieh, H., Moore, J.M., Shipman, F.M.: Patterns of reading and organizing information in document triage. Proc. Am. Soc. Inf. Sci. Technol. 43(1), 1–27 (2006)

    Google Scholar 

  3. Buchanan, G., Blandford, A., Thimbleby, H., Jones, M.: Integrating information seeking and structuring: exploring the role of spatial hypertext in a digital library. In: Proceedings of the Fifteenth ACM Conference on Hypertext and Hypermedia, pp. 225–234. ACM (2004)

    Google Scholar 

  4. Buchanan, G., Blandford, A., Thimbleby, H., Jones, M.: Supporting information structuring in a digital library. In: Heery, R., Lyon, L. (eds.) ECDL 2004. LNCS, vol. 3232, pp. 464–475. Springer, Heidelberg (2004). doi:10.1007/978-3-540-30230-8_42

    Chapter  Google Scholar 

  5. Buchanan, G., Loizides, F.: Investigating document triage on paper and electronic media. In: Kovács, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 416–427. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74851-9_35

    Chapter  Google Scholar 

  6. Cole, M., Liu, J., Belkin, N., Bierig, R., Gwizdka, J., Liu, C., Zhang, J., Zhang, X.: Usefulness as the criterion for evaluation of interactive information retrieval. In: Proceedings of the Third Workshop on Human-Computer Interaction and Information Retrieval, HCIR 2009, pp. 1–4 (2009)

    Google Scholar 

  7. Ellis, D.: Modeling the information-seeking patterns of academic researchers: a grounded theory approach. Libr. Q. 63, 469–486 (1993)

    Article  Google Scholar 

  8. Ellis, D., Cox, D., Hall, K.: A comparison of the information seeking patterns of researchers in the physical and social sciences. J. Doc. 49(4), 356–369 (1993)

    Article  Google Scholar 

  9. Fowler, M., Bellis, C., Perry, C., Kim, B.: Exploring web-based visual interfaces for searching research articles on digital library systems (2016)

    Google Scholar 

  10. Hienert, D., Sawitzki, F., Mayr, P.: Digital library research in action: supporting information retrieval in sowiport. D-Lib Mag. 21(3), 8 (2015)

    Google Scholar 

  11. Jonker, D., Wright, W., Schroh, D., Proulx, P., Cort, B., et al.: Information triage with TRIST. In: International Conference on Intelligence Analysis, pp. 2–4 (2005)

    Google Scholar 

  12. Kelly, D.: Methods for evaluating interactive information retrieval systems with users. Found. Trends Inform. Retrieval 3(1–2), 1–224 (2009)

    Google Scholar 

  13. Loizides, F.: Understanding and conceptualising the document triage process through information seekers’ visual and navigational attention. Ph.D. thesis, City University (2012)

    Google Scholar 

  14. Loizides, F., Buchanan, G., Mavri, K.: Theory and practice in visual interfaces for semi-structured document discovery and selection. Inf. Serv. Use 35(4), 259–271 (2016)

    Google Scholar 

  15. Marshall, C.C., Shipman III., F.M.: Spatial hypertext and the practice of information triage. In: Proceedings of the Eighth ACM Conference on Hypertext, pp. 124–133. ACM (1997)

    Google Scholar 

  16. Robertson, G., Czerwinski, M., Larson, K., Robbins, D.C., Thiel, D., Van Dantzich, M.: Data mountain: using spatial memory for document management. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, pp. 153–162. ACM (1998)

    Google Scholar 

  17. Schwarzkopf, E.: Enhancing the interaction with information portals. In: Proceedings of the 9th International Conference on Intelligent User Interfaces, pp. 322–324. ACM (2004)

    Google Scholar 

  18. Shipman III., F.M., Hsieh, H., Maloor, P., Moore, J.M.: The visual knowledge builder: a second generation spatial hypertext. In: Proceedings of the 12th ACM Conference on Hypertext and Hypermedia, NY, USA, pp. 113–122 (2001). http://doi.acm.org/10.1145/504216.504245

  19. Shneiderman, B., Feldman, D., Rose, A., Grau, X.F.: Visualizing digital library search results with categorical and hierarchical axes. In: Proceedings of the Fifth ACM Conference on Digital Libraries, pp. 57–66. ACM (2000)

    Google Scholar 

  20. Small, H.: Co-citation in the scientific literature: a new measure of the relationship between two documents. J. Am. Soc. Inf. Sci. 24(4), 265–269 (1973). doi:10.1002/asi.4630240406

    Article  Google Scholar 

  21. Toms, E.G., Villa, R., McCay-Peet, L.: How is a search system used in work task completion? J. Inform. Sci. 39, 15–25 (2013)

    Article  Google Scholar 

  22. Wong, B.L.W., Choudhury, S.T., Rooney, C., Chen, R., Xu, K.: INVISQUE: technology and methodologies for interactive information visualization and analytics in large library collections. In: Gradmann, S., Borri, F., Meghini, C., Schuldt, H. (eds.) TPDL 2011. LNCS, vol. 6966, pp. 227–235. Springer, Heidelberg (2011). doi:10.1007/978-3-642-24469-8_24

    Chapter  Google Scholar 

Download references

Acknowledgements

We thank all volunteers that participated in our study and the focus group on interactive information retrieval at GESIS.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dagmar Kern .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Kern, D., Lusky, M., Wacker, D. (2017). Evaluating the Usefulness of Visual Features for Supporting Document Triage. In: Kamps, J., Tsakonas, G., Manolopoulos, Y., Iliadis, L., Karydis, I. (eds) Research and Advanced Technology for Digital Libraries. TPDL 2017. Lecture Notes in Computer Science(), vol 10450. Springer, Cham. https://doi.org/10.1007/978-3-319-67008-9_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67008-9_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67007-2

  • Online ISBN: 978-3-319-67008-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics