How’s our library e-service? Measuring user satisfaction in the virtual environment

Размещено на http://www.allbest.ru/

Nazarbayev University Library

How's our library e-service? Measuring user satisfaction in the virtual environment

MANABAT A.R.

Astana

Annotation

Objective. This study aims to determine the satisfaction with the virtual reference service of library users of Nazarbayev University Library during the Spring 2021 to Spring 2022 semesters. Methods. This study employed a descriptive approached to determine the satisfaction of users with the virtual service of Nazarbayev University Library during the Spring 2021 to Spring 2022 semesters. Using the data gathered from LibAnswers' Quality of Service (QoS), this study examines various metrics in answering the queries received both in synchronous (chat service) or asynchronous (email service) virtual service. Statistical data from were tabulated and analyzed and the feedback from patrons will be interpreted using Voyant Tools, a web-based data visualization software. Results. The study describe how patrons were satisfied with the virtual library service of NU Library as perceived through their feedback and their overall experience of the service. In addition, the study pointed out that the Library considers all virtual transactions urgent and put the satisfaction of their patrons on top priority based on the metrics. Conclusions. The study revealed that patrons were satisfied with the virtual service rendered by NU Library both in synchronous and asynchronous format. With the help of the metrics generated from LibAnswers Quality of Service (QoS) feature, the NU Library was able to provide an excellent service despite the limitations brought by the pandemic. The feedback from patrons was indeed a proof of their satisfaction. As service quality and user satisfaction will always go together, the library, as a service-oriented information arm of any institution, should always put their patrons as their top priority.

Keywords: user satisfaction; virtual library service; service quality; Quality of Service (QoS); Nazarbayev University; Kazakhstan

Анотація

MANABAT A. R. Бібліотека Назарбаєв університету (Астана, Казахстан)

Як вам наші бібліотечні електронні сервіси? Вимірювання задоволеності користувачів у віртуальному середовищі

Мета. Дане дослідження має на меті визначити задоволеність користувачів бібліотеки віртуальним сервісом Бібліотеки Назарбаєв Університету протягом весняного семестру 2021 - весняного семестру 2022 року. Методи. У дослідженні використано описовий підхід для визначення задоволеності користувачів віртуальним сервісом Бібліотеки Назарбаєв Університету протягом весняного семестру 2021 - весняного семестру 2022 року. Використовуючи дані, зібрані в рамках дослідження якості обслуговування LibAnswers (QoS), були розглянуті різні метрики у відповідях на запити, отримані як у синхронному (чатсервіс), так і в асинхронному (електронна пошта) віртуальному сервісі. Статистичні дані були зведені в таблиці та проаналізовані, а відгуки відвідувачів інтерпретовані за допомогою веб-програми візуалізації даних Voyant Tools. Результати. Дослідження описує, наскільки користувачі задоволені віртуальним бібліотечним сервісом Бібліотеки Назарбаєв Університету, згідно з їхніми відгуками та загальним досвідом роботи з сервісом. Крім того, дослідження показало, що бібліотека вважає всі віртуальні транзакції невідкладними і ставить задоволення своїх користувачів на перше місце на основі метрик. Висновки. Дослідження показало, що користувачі задоволені віртуальним сервісом, який надає Бібліотека Назарбаєв Університету як в синхронному, так і в асинхронному форматі. За допомогою метрик, згенерованих функцією LibAnswers' Quality of Service (QoS), бібліотека змогла забезпечити відмінний сервіс, незважаючи на обмеження, спричинені пандемією. Відгуки відвідувачів були справді доказом їхнього задоволення. Оскільки якість обслуговування та задоволеність користувачів завжди йтимуть разом, бібліотека, як сервіс-орієнтований інформаційний підрозділ будь-якої установи, завжди повинна ставити своїх користувачів на перше місце серед своїх пріоритетів.

Ключові слова: задоволеність користувачів; віртуальний бібліотечний сервіс; якість обслуговування; Quality of Service (QoS); Назарбаєв Університет; Казахстан

Introduction

library virtual service user

Measuring user satisfaction even in the traditional or face-to-face setting is quite difficult. With the onset of COVID-19 pandemic, more and more libraries have been offering virtual library services to ensure continuous delivery of services and resources and gauging how satisfied our patrons are might even be more challenging. Although offering library service in a virtual environment has been done even before the pandemic (Vogus, 2020), determining if we satisfy our user's needs is still quite tricky. As the heart of the learning community (Kiran, 2010), university libraries have always been living its mandate to support informational, research, scholarly, and recreational needs of its users and is expected to deliver service whenever, wherever.

Libraries has proven itself relevant despite the changing demands of the time. From a mere repository of print materials to an information hub of various formats including online resources; from just a traditional reference desk to a virtual reference assistant, the library has indeed no doubt repositioned itself in the educational landscape. However, libraries continue to face some challenges as learners resort to get information from various options and competitive sources (Twum et al., 2022). In addition, as learners became even more online and distant, they tend to be self-sufficient (Oliveira & Greenidge, 2020, p. 21), that means that they prefer and resort to getting their own materials without any assistance (Yap & Manabat, 2021, p. 4). With the ever-increasing amount of information available online, libraries need to assert itself in the information landscape by assessing the quality of the service being rendered to their clients alongside improving user satisfaction (Kiran, 2010) as this will also ensure “increase in their user base and remain to be responsive on meeting their users' expectations” (Adeniran, 2011, p. 209).

Gauging user satisfaction has indeed imperative for any service-oriented institutions and organizations from the get-go and users or customers' voices always matter (Adeniran, 2011). Libraries as service-oriented informational arm of any organizations, should also seek ways on how to assess their service as perceived by the users and improve it based on their feedback. With majority of library services going virtual especially with the onset of pandemic, it became even more challenging and tricky for libraries to determine if they meet user expectations. To further help libraries on this, various models and tools were created and introduced to provide a deep dive on analyzing user satisfaction to improve service quality and to make informed decisions.

Service Quality in Libraries

Service quality is defined as `the overall evaluation of a specific service firm that results from comparing that firm's performance with the customer's general expectations of how firms in that industry should perform' (Parasuraman et al., 1988, p. 15) and with the intensified competition, having a superb “service quality seems to be a prerequisite to success, if not survival” (p. 15). To provide a more structured approach in measuring the service quality, Zeithaml, Parasuraman, and Berry (1988) introduced SERVQUAL, a set of 22 pairs of statements used to measure user expectations in the marketing field. These statements focuses on five interrelated dimensions that customers most value when they assess the quality of service regardless of providers (Kiran, 2010; Nitecki & Hernon, 2000; Smith, 2010; Wang & Shieh, 2006):

• Tangibles (physical facilities, equipment, and the appearance of personnel);

• Reliability (ability to perform the promised service dependably and accurately);

• Responsiveness (willingness to help customers and provide prompt service);

• Assurance (knowledge and courtesy of employees and their ability to inspire trust and confidence); and

• Empathy (caring, individualized attention the firm provides its customers)

In the library context, service quality is “the overall excellence of library services that satisfy users' expectation” (Wang & Sheih, 2006, p. 195). Over the years, there were studies conducted focusing on service quality in libraries. With regards to library service quality, there are several determinants to look out for such as electronic resources, collections of printed publications, other library services, technical facilities, library environment, and human side of user service based on the study conducted by Martensen & Gronholdt (2003). The application of SERVQUAL model and its ability of monitor library service quality were highlighted in the studies conducted by Nitecki (1996), Nitecki & Hernon (2000), Kiran (2010), and Gathoni & Van der Walt (2019). Aside from SERVQUAL, the LIBQUAL model introduced by Association of Research Libraries in 1999 was also evident on the studies conducted by Cristobal (2018), Dahan et al. (2016), and Pedramnia (2012). It offers a standard measure of services dedicated to libraries which consists of 25 items that focuses on gauging user perception on service quality in the library setting aligned in these four dimensions and has further determined the relationship of service quality, user satisfaction, and loyalty in libraries (Twum et al., 2022; Cook et al., 2003):

1. Service affect - relates to the human side of libraries consisting of traits of empathy, personal competence, and accessibility.

2. Library as place - consisting of various issues from the users' perspective on the space of study and collaboration, a sanctuary for contemplation and reflection.

3. Information access - library users' assessment of the adequacy of library collections, and their ability to have access to needed information conveniently or regardless of the medium of the resource in question.

4. Personal control - the extent to which library users are able to navigate and have control of the information provided by the library on the internet.

Customer Satisfaction

Law J. (2011) defined customer satisfaction as the degree to which customer expectations of a product or service are met or exceeded. In addition, it is also a “consumer's fulfillment response, which act as an evaluation based on an emotion-based response to a product or service received” (Ahmad & Allan, 2014, p. 17). This further denotes that customer satisfaction is an evaluation of quality of products and services received that adheres to their needs and wants (p. 17). In the simplest sense, customer satisfaction stresses on perceptions, expectations, and evaluation (p. 17). Putting this on the context of libraries, customer satisfaction is defined as “the levels of service quality performances that meets users' expectations” (Wang & Shieh, 2006, p. 197).

Organizations should understand the perceptions and expectations of customers towards a certain product or service (Ahmad & Allan, 2014). These comes from their experiences and feelings as well belief, opinion, and predictions about the products and services they received (p. 20). Therefore, to measure customer satisfaction, it is also essential to know your customers even in libraries.

Service Quality and Customer Satisfaction

Service quality and customer satisfaction are very much related concepts. Service quality should be treated as an antecedent of customer satisfaction (Twum et al., 2022; Wang & Shieh, 2006;). The measure of service quality differs from one person to another as people comes from various backgrounds, beliefs, experiences, perceptions, and expectations, thus, customers, given these factors, are the determinants of service quality (Ahmad & Allan (2014). Having said that, there is a need for the organization to know the customer's perceptions and expectation before and after using the product or service. This is primarily the reason why some organizations conduct a user needs assessment as well as a user evaluations to manage both the user perceptions and expectations. As noted by Ahmad & Allan (2014), satisfaction is defined to be “the gap between the perception and expectation of the end-user”, thus, “customer satisfaction should be measured only by performance” (p. 20) as service “quality is also a pride of workmanship” (p. 45). This also applies in organization such as libraries which are primarily service-oriented and a quality service is also expected. Satisfaction of library users is result of their perception of the quality of library services, thus, service quality will give way to user satisfaction resulting to user loyalty and patronage in libraries (Twum et al., 2022).

SpringShare LibAnswers ' Quality of Service (QoS)

One of the tools used nowadays to measure user satisfaction with regards to library services is the LibAnswers' Quality of Service (QoS) feature of SpringShare. Launched in January 2021, this new feature aims to gather statistics dedicated to assessing the quality of service libraries provided through LibAnswers' chat and tickets (SpringShare, 2021). This also gathers user feedback and analyze metrics relevant to virtual reference and library assistance “to reduce dissatisfied tickets, enhance patron satisfaction, and capture staff output” (Breeding, 2021).

To measure the user satisfaction on library virtual services, the NU Library decided to introduce Quality of Service (QoS) feature in March 2021. This new feature of the SpringShare's LibAnswers is designed to collect patron feedback on their overall satisfaction with the library's virtual service. Metrics such as checking the turnaround time in answering tickets and chats and the number of interactions, replies, as well as ratings were also generated from this feature. To get the user feedback, the Library sends a customizable follow-up survey to at least 25% of the closed tickets everyday. With this new feature, the Library was able determine not just the patrons' feedback but also the promptness of the response or service. Given the metrics, the Library was also able to further improve the service rendered to the academic community.

Objectives

Given that gauging user satisfactions is quite challenging especially in a virtual library service, this study aims to determine the satisfaction of users with the virtual service of Nazarbayev University Library during the Spring 2021 to Spring 2022 semesters. Using the data gathered from LibAnswers' Quality of Service (QoS) from March 2021 to June 2022, this study examines various metrics such as the turnaround time and the number of interactions in answering the queries received both in synchronous (chat service) or asynchronous (email service) reference service. In addition, feedback from users were also explored and considered to determine the overall effectiveness virtual reference service as well as the areas that need to be improved.

Methodology

This study employed a descriptive approached to determine the satisfaction of users with the virtual service of Nazarbayev University Library during the Spring 2021 to Spring 2022 semesters. Using the data gathered from LibAnswers' Quality of Service (QoS) from March 2021 to June 2022, this study examines various metrics in answering the queries received both in synchronous (chat service) or asynchronous (email service) virtual service such as:

• the turnaround time;

• the number of interactions;

• the number of replies;

• the duration of each transaction; and

• the ratings.

In addition, feedback from users were also explored and considered to determine the overall effectiveness of the virtual library service as well as the areas that need to be improved. Statistical data from the LibAnswers' QoS were tabulated and analyzed and the feedback from patrons will be interpreted using Voyant Tools, a web-based data visualization software. For data visualization, the tools used were Cirrus, a word cloud that visualizes the top frequent words used; a Collocates Graph which represents keywords and terms that occur in proximity as a force directed network graph; and Bubbles, a playful visualization of term frequencies of a corpus (Sinclair & Rockwell, 2022), or in the context of this study, the feedback from the users gathered from QoS.

Results and Discussions

To measure the user satisfaction on library virtual services, the NU Library decided to introduce Quality of Service (QoS) feature in March 2021. This new feature of the SpringShare's LibAnswers is designed to collect patron feedback on their overall satisfaction with the library's virtual reference service. This includes some metrics such as checking the turnaround time in answering tickets and chats and the number of interactions before closing the tickets. From March 2021 to June 2022, the NU Library received 3,534 tickets and 1,732 chat transactions.

Ticket Turnaround

One of the determinants of service quality is the responsiveness in providing the service. This includes the willingness to assist the clients and provide prompt service in no time. The QoS has the ability to analyze metrics with regards to how long it takes for the operator to reply to a patron's question and the time duration from the moment the question is asked up to the time the ticket has been closed.

For NU Library, all tickets were received through the dashboard. These tickets came from the official email address of the Library. From March 2021 to June 2022, out of 3,534 ticket transactions, 2,045 tickets or 58% were answered in less than an hour from the time the transaction was received as noted on the Table 1 below. This means that the operators assigned to monitor the tickets on the dashboard ensures that all tickets were handled as quick as possible. To ensure that all tickets were handled, dashboard monitoring and scheduling has been implemented for all responsible departments assigned. In addition, it was agreed among the operators that tickets should be handled at least within 10 minutes from the time it was received from the dashboard.

Table 1

Tickets Turnaround Time Before Getting Answered (1st Reply) from March 2021 to June 2022 (Source: Statistics: Quality of Service (QoS) | 2022, August 31)