학술논문

Post-OCR Paragraph Recognition by Graph Convolutional Networks
Document Type
Conference
Source
2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) WACV Applications of Computer Vision (WACV), 2022 IEEE/CVF Winter Conference on. :2533-2542 Jan, 2022
Subject
Computing and Processing
Adaptation models
Text recognition
Convolution
Computational modeling
Image edge detection
Layout
Training data
Document Analysis Deep Learning -> Graph Neural Networks
Language
ISSN
2642-9381
Abstract
We propose a new approach for paragraph recognition in document images by spatial graph convolutional networks (GCN) applied on OCR text boxes. Two steps, namely line splitting and line clustering, are performed to extract paragraphs from the lines in OCR results. Each step uses a β-skeleton graph constructed from bounding boxes, where the graph edges provide efficient support for graph convolution operations. With pure layout input features, the GCN model size is 3~4 orders of magnitude smaller compared to RCNN based models, while achieving comparable or better accuracies on PubLayNet and other datasets. Furthermore, the GCN models show good generalization from synthetic training data to real-world images, and good adaptivity for variable document styles.