Enhanced RoBERTa Model for OCR-Based EHR Parsing and Information Extraction
Balaji Ganesh Rajagopal1, Amarnath C1, Chidambaram Sawri Rajan2 & Deebalakshmi Ramalingam1 Show affiliations
- School of Computing, SRM Institute of Science and Technology, Tiruchirappalli, India
- Chidambaram Sawri Rajan CEO, EMEDLOGIX SOLUTIONS Chennai, India
Journal of Computer Science, Volume 22, Issue 4, pp. 1434–1447 · doi.org/10.3844/jcssp.2026.1434.1447
Abstract
Healthy source data for medical research and health analytics in general can be obtained from Electronic Health Records (EHRs). Nevertheless, due to the complexities of the design and especially the unstructured nature of them, it is not easy to extract important information from digital documents. This paper proposes a fundamentally new approach to the problem of interpreting EHRs obtained by Optical Character Recognition (OCR) that utilizes a refined RoBERTa foundation architecture. Basically, our method is very efficient in extracting key elements, like section headings and bold words, which most of the time have very significant clinical significance. More than just straightforward text recognition is the use of RoBERTa for semantic understanding. 89. 2% is the accuracy of the tests that we have performed. This paper presents an exhaustive benchmarking of the pros and cons of the deep learning techniques that are currently being used for parsing EHRs. However, our model is fixing the problem of very accurately extracting bold section heads from unstructured data in EHRs. The system proposes a two-phase approach combining natural language and image processing techniques. Performing thinning and normalizing operations first to separate bold texts based on pixel intensity over a preset threshold. By successfully removing the needless text from the paragraphs, our method significantly enhances the accuracy of bold word extraction, reaching 98%.
Licence and reuse
Open access. This article is licensed under a Creative Commons Attribution 4.0 International Licence (CC BY 4.0), as printed on the article, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original authors and the source. No permission is needed.
How to reuse this articleResponses (0)
About this article
Rajagopal, B. G., C, A., Rajan, C. S. & Ramalingam, D. (2026). Enhanced RoBERTa Model for OCR-Based EHR Parsing and Information Extraction. Journal of Computer Science, 22(4), 1434–1447. https://doi.org/10.3844/jcssp.2026.1434.1447
- Licence
- CC BY 4.0
- Issue
- Volume 22, Issue 4
- Policies
- Editorial independenceUse of generative AIData availabilityAppeals and complaints
- Version
- Version of record
