This Article Full Text (PDF) All Versions of this Article: 0165551507082592v1 34/2/213    most recent References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in ISI Web of Science Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Pong, J. Y.-H. Articles by Wong, P. C.-C. Search for Related Content Social Bookmarking                   What's this?

A comparative study of two automatic document classification methods in a library setting

Run Run Shaw Library, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong

Ron Chi-Wai Kwok

Department of Information Systems, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong, isron{at}cityu.edu.hk

Raymond Yiu-Keung Lau

Department of Information Systems, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong

Jin-Xing Hao

Department of Information Systems, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong

Percy Ching-Chi Wong

Department of Information Systems, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong

In current library practice, trained human experts usually carry out document cataloguing and indexing based on a manual approach. With the explosive growth in the number of electronic documents available on the Internet and digital libraries, it is increasingly difficult for library practitioners to categorize both electronic documents and traditional library materials using just a manual approach. To improve the effectiveness and efficiency of document categorization at the library setting, more in-depth studies of using automatic document classification methods to categorize library items are required. Machine learning research has advanced rapidly in recent years. However, applying machine learning techniques to improve library practice is still a relatively unexplored area. This paper illustrates the design and development of a machine learning based automatic document classification system to alleviate the manual categorization problem encountered within the library setting. Two supervised machine learning algorithms have been tested. Our empirical tests show that supervised machine learning algorithms in general, and the k-nearest neighbours (KNN) algorithm in particular, can be used to develop an effective document classification system to enhance current library practice. Moreover, some concrete recommendations regarding how to practically apply the KNN algorithm to develop automatic document classification in a library setting are made. To our best knowledge, this is the first in-depth study of applying the KNN algorithm to automatic document classification based on the widely used LCC classification scheme adopted by many large libraries.

Key Words: automatic document classification • text categorization • machine learning • k-nearest neighbours classifier • naive Bayes classifier • library practice

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?