Art. 02 – Vol. 21 – No. 1 – 2011

Preliminary Development of LibEval Model for Quality Evalution of On-line Libraries

Alexandru Balog
National Institute for Research & Development of Informatics – ICI Bucharest

Abstract: The paper presents researches conducted for the development of LibEval model, a system for on-line libraries quality evaluation. For the development of LibEval model it has been used a frame methodology for development, testing and validation of the model. Special care was given to the preliminary development of the model by defining the concept and identifying the dimensions and the evaluation criteria. The evaluation criteria were used in testing the model by conducting a survey based on a questionnaire. There are also presented the preliminary results of the survey, and the output obtained from the statistic analysis of data.

Keywords: online library, digital library, evaluation model, quality evaluation, measurement scale, questionnaire-based survey.

View full article


  1. AGOSTI, M.; N. FERRO; E. A. FOX; M. A. GONCALVES; B. Towards a Reference Quality Model for Digital Libraries. First International Workshop on Digital Libraries Foundations, Vancouver, British Columbia, Canada, June 23, 2007.
  2. AGOSTI, M., N. FERRO; E. A. FOX; M. A. GONCALVES. Modelling DL Quality: a Comparison between Approaches: the DELOS Reference Model and the 5S Model. Second DELOS Conference on Digital Libraries, 5-7 Dec. 2007, Pisa, Italy.
  3. BALOG, AL. Aspecte metodologice privind dezvoltarea modelului de măsurare a calităţii serviciilor publice on-line (E-ServEval). Revista Română de Informatică şi Automatică vol. 18, nr. 2, 2008, pag. 15-30.
  4. BALOG, AL. şi colectiv. Evaluarea calităţii şi performanţelor bibliotecilor on-line (LibEval). Contract 11012/2007, Faza 5 – Experimentarea şi demonstrarea funcţionalităţii şi utilităţii modelelor şi metodelor de evaluare, decembrie 2010.
  5. BALOG, AL. Dezvoltarea şi testarea unui model ierarhic de evaluare a calităţii bibliotecilor on-line. Revista Română de Interacţiune Om-Calculator, 2011 (transmis spre publicare).
  6. BALOG, AL.; PEREŢEANU. Cercetări privind evaluarea calităţii şi performanţei bibliotecilor on-line. Revista Română de Informatică şi Automatică vol. 18, nr. 2, 2008, pag. 43-54.
  7. BANCIU, D. Biblioteca virtuală. În: Probleme de informare şi documentare, 1997, vol. 31, nr. 1-2, p. 122-124.
  8. BERTOT, J. C. Libraries and Networked Information Services: Issues and Consideration in Measurement. Performance Measurement and Metrics Vol. 5, No. 1, 2004, pp. 11-19.
  9. COSTELLO, A. B.; J. W. OSBORNE. Best Practices in Exploratory Factor Analysis, Practical Assessment, Research and Evaluation vol. 10, no. 7, pp.1-9.
  10. DELONE, W. H., E. R. The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems vol. 19, no. 4, pp. 9-30.
  11. ERICH, A.: Biblioteca digitală: calea de transfer dinspre biblioteca tradiţională spre biblioteca virtuală. Revista română de biblioteconomie şi ştiinţa informării, Anul 3, nr. 2, 2007.
  12. FUHR, N.; P. HANSEN; M. MABE; A. MICSIK. Digital Libraries: A Generic Classification and Evaluation Scheme. ECDL’01: Proc. of the 5th European Conference on Research and Advanced Technology for Digital Libraries, London, UK, Springer-Verlag, pp. 187-199.
  13. FUHR, N.; G. TSAKONAS et al. Evaluation of digital libraries. Int’l Journal on Digital Libraries, vol. 8, no. 1, 2007, pp. 21-38.
  14. GONÇALVES, M. A.; B. LAGOEIRO; E. A. FOX; L. T. What is a Good Digital Library? A Quality Model for Digital Libraries. Information Processing & Management, vol. 43, no.5, pp. 1416-1437.
  15. HAIR, J. F.; W. C. BLACK; B. J. BABIN; R. E. ANDERSON; R. L. Multivariate Data Analysis. 6th ed., Prentice Hall, 2006.
  16. IVAN, I., A. SANDU; D. MILODIN; C. LUGOJI. Orthogonally based digital content management applicable to projects-bases. Informatica Economică 13, no. 3, 2009, pp. 140-152.
  17. JENG, J. Usability Assessment of Academic Digital Libraries: Effectiveness, Efficiency, Satisfaction, and Learnability. Libri , Vol. 55, 2005, pp. 96-121.
  18. KYRILLIDOU, M.; S. GIERSCH. Developing the DigiQUAL Protocol for Digital Library Evaluation. JCDL ’05, June 7-11, 2005, Denver, Colorado, USA.
  19. KYRILLIDOU, M.; F. HEATH; C. COOK; B. THOMPSON. DigiQUALä: A Digital Library Evaluation Service. Research paper presented at the 7th Northumbria Int. Conf. on Performance Measurement in Libraries and Information Services (PM7), 13-16 August 2007, South Africa.
  20. LAKOS, A.; S. PHIPPS. Creating a Culture of Assessment: A Catalyst for Organizational Change. portal: Libraries and the Academy, Vol. 4, No. 3, 2004, pp. 345-361.
  21. MARCHIONINI, G. Evaluating digital libraries: a longitudinal & multifaceted view. Library Trends, vol.49, no. 2, 2000, pp. 304-333.
  22. MOREIRA, B.L.; M. A. GONÇALVES; A. H. F. LAENDER; E. A. FOX. 5SQual – A Quality Assessment Tool for Digital Libraries. JCDL07: Proc. of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries, 2007. p. 513.
  23. NICHOLSON, S. A conceptual framework for the holistic measurement and cumulative evaluation of library services. Journal of Documentation vol. 60, no. 2, 2004, pp.164-182.
  24. PARASURAMAN, A.; V. A. ZEITHAML; A. MALHOTRA. E-S-QUAL : A Multiple-Item Scale for Assessing Electronic Service Quality. Journal of Service Research nr. 7, 2005, pp. 213-233.
  25. PETER, S.; W. DELONE; E. MCLEAN. Measuring information systems success: models, dimensions, measures, and interrelationships. European Journal of Information Systems, vol. 17, 2008, pp. 236-263.
  26. SARACEVIC, T. Digital library evaluation: toward an evolution of concepts. Library Trends vol. 49, no. 3, 2000, pp. 350-369.
  27. SARACEVIC, T. Evaluation of Digital Libraries: An Overview. In: Agosti,M., Fuhr, N. (eds): Notes of the DELOS WP7 Workshop on the Evaluation of Digital Libraries. Padova, Italy,
  28. SARACEVIC, T.; P. B. KANTOR. Studying the value of library and information services. Part II. Methodology and taxonomy. Journal of The American Society of Information Science vol.48, no.6, 1997, pp. 543-563.
  29. STRAUB, D.; M. C. BOUDREAU; D. GEFEN. Validation Guidelines for IS Positivist Research. Communications of the Association for Information Systems, vol. 13, 2004, pp. 380-427.
  30. TÎRZIMAN, E. Biblioteca digitală – o încercare de definire. In : “Curier: revistă de cultură şi bibliologie”. Târgovişte: Biblioteca “Ion Heliade-Rădulescu”, an XII, nr. 1-2(22-23), 2005, pp. 28-30.
  31. TSAKONAS, G.; C. PAPATHEODOROU. Analyzing and Evaluating Usefulness and Usability in Electronic Information Services, Journal of Information Science, Vol. 32(5), 2006, 400-419.
  32. TSAKONAS, G.; C. PAPATHEODOROU. Exploring usefulness and usability in the evaluation of open access digital libraries. Information Processing and Management vol. 44, 2008, pp. 1234-1250.
  33. XIE, H. Evaluation of digital libraries: Criteria and problems from users’ perspectives. Library and Information Science Research vol. 28, no. 3, 2006, pp. 433-452.
  34. ZHANG, Y. Developing a holistic model for digital library evaluation. Journal of the American Society for Information Science and Technology vol.61, no.1, 2010, pp. 88-110

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.