Intelligent Indexing: A Semi-Automated, Trainable System for Field Labeling

Citation data:

Brigham Young University - Provo

Publication Year:
Usage 55
Abstract Views 38
Downloads 17
Repository URL:;
Clawson, Robert T
Brigham Young University - Provo
historical document processing; handwriting recognition; indexing; machine learning; human-computer interaction; Computer Sciences
thesis / dissertation description
We present Intelligent Indexing: a general, scalable, collaborative approach to indexing and transcription of non-machine-readable documents that exploits visual consensus and group labeling while harnessing human recognition and domain expertise. In our system, indexers work directly on the page, and with minimal context switching can navigate the page, enter labels, and interact with the recognition engine. Interaction with the recognition engine occurs through preview windows that allow the indexer to quickly verify and correct recommendations. This interaction is far superior to conventional, tedious, inefficient post-correction and editing. Intelligent Indexing is a trainable system that improves over time and can provide benefit even without prior knowledge. A user study was performed to compare Intelligent Indexing to a basic, manual indexing system. Volunteers report that using Intelligent Indexing is less mentally fatiguing and more enjoyable than the manual indexing system. Their results also show that it reduces significantly (30.2%) the time required to index census records, while maintaining comparable accuracy. A helpful video resource for learning more about this research is available on youtube through this link: