Information Services

Lightning Talk: Program Description Abstract

"Sieving" Your Search: Semi-Automated Citation Screening for Search Strategy Refinement

Monday, May 6
4:45 PM - 4:50 PM
Room: Columbus KL (East Tower, Ballroom/Gold Level)

Background : Those who develop search hedges and systematic review strategies often use a process where they measure how effective a given search is at retrieving items from a set of “gold standard” articles. While this is a robust method, it is also resource-intensive. There are many occasions when a searcher needs to refine a search strategy in an iterative way, but she does not have time to manually assemble a set of exemplar citations. This describes an application that would allow a searcher to test different iterations of a search strategy against a set of “known-good” citations in a streamlined way.

Description : This application, currently under development, will allow a user to test and refine searches against PubMed, which is both eminently suited to biomedical searchers and possessed of a robust API for developers. The task flow will begin with a user’s initial search, after which she will be presented with a limited, randomly chosen set of search results. She will then examine the citation (and abstract, if available) of each result and determine whether it is relevant to her search task or not.

Citations marked as relevant will be stored as “known-good” (or at least “likely-good”) items for that search, while those that are obviously irrelevant can be deemed “known-bad”. From there, successive search strategies can be automatically tested in the application as to how well they retrieve the desired citations while also avoiding the bad ones.

Conclusion : By having a way to easily quantify the performance of different strategies, it is possible that this application could improve the rigor of “everyday” searches for complex topics. User testing will be necessary to refine this concept. In particular, the author would wish to determine the minimum number of items needed for examination in the initial stage in order to provide reliable information as to how well successive searches perform.


Edwin Vincent Sperr Jr., AHIP

Clincial Information Librarian
AU/UGA Medical Partnership
Athens, Georgia

A native of Augusta, Georgia, Ed Sperr earned a Bachelor of Arts from the University of Georgia and a Masters of Library and Information Science from the University of South Carolina. He has worked in libraries in the Southeast, New England and the Caribbean.

Since developing the interactive tool PubVenn in 2015, Ed has explored the use the of data visualization techniques in several different contexts. He has presented his work at both regional and national meetings. He is also interested in how the techniques of improvisational theatre can be used to improve communication skills, and has presented several improv workshops.

As the Partnership's Clinical Information Librarian, Ed provides point-of-care information to the Residents in the Graduate Medical Education program and works with them to develop the skills needed to find and evaluate the information necessary for clinical decision-making.


Send Email for Edwin Sperr Jr.


"Sieving" Your Search: Semi-Automated Citation Screening for Search Strategy Refinement

Audio Slides Video

Attendees who have favorited this

Please enter your access key

The asset you are trying to access is locked. Please enter your access key to unlock.

Send Email for "Sieving" Your Search: Semi-Automated Citation Screening for Search Strategy Refinement