Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Click here to sign up for SAGE Journal Email Alerts today!

Sign In to gain access to subscriptions and/or personal tools.
Journal of Information Science
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in ISI Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via ISI Web of Science (13)
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by White, V. J.
Right arrow Articles by Sheldon, T. A.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?

A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy

V. J. White

University of York, UK

J. M. Glanville

University of York, UK, jmg1{at}york.ac.uk

C. Lefebvre

University of York, UK

T. A. Sheldon

University of York, UK

Search filters are increasingly used to search medical databases to identify specific topics or study designs. In particular, search filters have been designed to help health-care professionals identify systematic reviews of the effectiveness of health interventions. Identifying systematic reviews in databases such as MEDLINE is problematic and research has previously been undertaken into methods to design search filters that retrieve systematic reviews effectively. The aim of this study was to improve previously developed methods to derive a more objective search strategy to identify systematic reviews in MEDLINE. A ‘quasi-gold standard’ collection of known systematic reviews was identified. A frequency analysis of words within a subset of the ‘quasi-gold standard’ was undertaken followed by a statistical analysis of the most frequently occurring words. This analysis determined which terms would best distinguish between systematic reviews, non-systematic reviews and non-reviews. The performance of the best models was tested on the remaining subset of ‘quasi-gold standard’ records and then using the OVID interface to MEDLINE. The best model had a sensitivity of 73.4% for systematic reviews in the test set and 84.2% when used with the validation set. The best model had a specificity of 98.3% in the test set and 93% in the validation set. When tested on the same ‘quasi-gold standard’ using OVID MED-LINE the model showed 100% sensitivity and 4.4% precision. The number of times a term occurs in a record adds discriminatory power to the search strategy. Apparently highly relevant terms chosen subjectively do not perform as well as those derived by a statistical approach. Some search terms may not immediately seem useful in identifying systematic reviews, but when used in combination with other terms they prove to be highly discriminating. The best performing filters were tested on the OVID interface, but without frequency and term weightings. Their performance was also compared to previously published filters. One of the strategies was found to perform better with respect to sensitivity than previously published filters, although with lower precision.

Journal of Information Science, Vol. 27, No. 6, 357-370 (2001)
DOI: 10.1177/016555150102700601
Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
 Research on Social Work PracticeHome page
B. J. Taylor
Invited Commentary on Papers by Holden et al. and Shek on the Quality of Social Work Abstracts
Research on Social Work Practice, May 1, 2009; 19(3): 366 - 369.
[PDF]

Home page
 Arch Pediatr Adolesc MedHome page
N. Boluyt, L. Tjosvold, C. Lefebvre, T. P. Klassen, and M. Offringa
Usefulness of Systematic Review Search Strategies in Finding Child Health Systematic Reviews in MEDLINE
Arch Pediatr Adolesc Med, February 1, 2008; 162(2): 111 - 116.
[Abstract] [Full Text] [PDF]

Home page
 Research on Social Work PracticeHome page
B. Taylor, E. Wylie, M. Dempster, and M. Donnelly
Systematically Retrieving Research: A Case Study Evaluating Seven Databases
Research on Social Work Practice, November 1, 2007; 17(6): 697 - 706.
[Abstract] [PDF]

Home page
 Journal of Information ScienceHome page
C. Goss, S. Lowenstein, I. Roberts, and C. DiGuiseppi
Identifying controlled studies of alcohol-impaired driving prevention: designing an effective search strategy
Journal of Information Science, April 1, 2007; 33(2): 151 - 162.
[Abstract] [PDF]