Evaluating Evaluation: a Study of How Electronic Resources Are Evaluated in New Zealand Special Libraries

Abstract

Despite the large amount of literature concerning the selection of electronic resources, there is little research on what criteria and methods are being used in real library environments. While some published studies exist for the academic sector, special libraries are not represented in the literature, and issues specific to them are unknown. This study addresses this knowledge gap by surveying special librarians in New Zealand. The study identifies the types of collection development policies they work with, what criteria and methods they use to select electronic resources, and what challenges they face when making selection decisions. An online survey was used to collect both quantitative and qualitative data, which was then analysed, and related back to the literature. The findings of the study show that not all the respondents are using collection development polices, however those that do use predominantly integrated policies. Most of the criteria and methods discussed in the literature are used in practice, however cost and content criteria are the most frequently used and are seen as the most important. Other criteria like functionality, vendor issues, and technological issues are used less frequently. Finding adequate resources, high costs coupled with limited budgets, and lack of support from vendors were the main challenges experienced by the respondents.