method: MapTest2024-05-05

Authors: Hongen Liu

Affiliation: Tianjin University

method: DS-LP2024-03-26

Authors: hsy

Affiliation: BUPT

Description: Four tasks unified submission
DeepSolo, Multi-Polygon NMS (word detection and recognition) -> LayoutPointer (word linking)

Authors: Yu Xie, Jielei Zhang, Ziyue Wang, Yuchen He, Yihan Meng, Weihang Wang, Peiyi Li, Longwen Gao

Affiliation: Bilibili Inc.

Description: In the Detection-Recognition-Linking task of MapText, we used ViTAE-v2 to extract global features, utilizing an encoder-decoder network architecture (DeepSolo). Data augmentation techniques such as cropping, scaling, saturation, and contrast adjustment were applied. Pre-training was conducted using available real datasets (TextOCR, TotalText, IC15, MLT2017). The model was fine-tuned on the MapText dataset, and post-processing methods were employed.

Zhang, Q., Xu, Y., Zhang, J., & Tao, D. (2023). Vitaev2: Vision transformer advanced by exploring inductive bias for image recognition and beyond. International Journal of Computer Vision, 131(5), 1141-1162.

Ye, M., Zhang, J., Zhao, S., Liu, J., Liu, T., Du, B., & Tao, D. (2023). Deepsolo: Let transformer decoder with explicit points solo for text spotting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 19348-19357).

Ranking Table

Description Paper Source Code
DateMethodQualityChar AccuracyF-scoreTightnessRecallPrecision
2024-05-05MapTest50.97%85.28%87.12%68.59%90.87%83.67%
2024-03-26DS-LP37.08%85.64%66.73%64.89%70.80%63.10%
2024-05-06MapText Detection-Recognition-Linking Strong Pipeline17.08%55.73%44.57%68.76%44.99%44.17%
2024-03-26Baseline TESTR Checkpoint6.05%41.46%21.22%68.73%12.95%58.71%

Ranking Graphic

Ranking Graphic

Ranking Graphic

Ranking Graphic