Making Sense of Bureaucratic Documents : Named Entity Recognition for State Authority Archives
Abstract
The usability and accessibility of digitised archival data can be improved using deep learning solutions. In this paper, the authors present their work in developing a named entity recognition (NER) model for digitised archival data, specifically state authority documents. The entities for the model were chosen based on surveying different user groups. In addition to common entities, two new entities were created to identify businesses (FIBC) and archival documents (JON). The NER model was trained by fine-tuning an existing Finnish BERT model. The training data also included modern digitally born texts to achieve good performance with various types of inputs. The finished model performs fairly well with OCR-processed data, achieving an overall F1 score of 0.868, and particularly well with the new entities (F1 scores of 0.89 and 0.97 for JON and FIBC, respectively).
Main Authors
Format
Conferences
Conference paper
Published
2024
Series
Subjects
Publication in research information system
Publisher
Society for Imaging Science & Technology
The permanent address of the publication
https://urn.fi/URN:NBN:fi:jyu-202410226451Use this for linking
Parent publication ISBN
978-0-89208-366-2
Review status
Non-peer reviewed
ISSN
2161-8798
DOI
https://doi.org/10.2352/issn.2168-3204.2024.21.1.2
Conference
Archiving Conference
Language
English
Published in
Archiving
Is part of publication
Archiving 2024 Final Program and Proceedings
Citation
- Poso, V., Lipsanen, M., Toivanen, I., & Välisalo, T. (2024). Making Sense of Bureaucratic Documents : Named Entity Recognition for State Authority Archives. In Archiving 2024 Final Program and Proceedings (pp. 6-10). Society for Imaging Science & Technology. Archiving, 21. https://doi.org/10.2352/issn.2168-3204.2024.21.1.2
Funder(s)
Research Council of Finland
Funding program(s)
Research infrastructures, AoF
Tutkimusinfrastruktuuri, SA

Copyright© Authors 2024