Competition Results

Results for track A, combined dataset


Rank Team IoU@0.6 IoU@0.7 IoU@0.8 IoU@0.9 WAvg. F1
Precision Recall F1 Precision Recall F1 Precision Recall F1 Precision Recall F1
1 TableRadar 0.9759 0.9636 0.9697 0.9660 0.9538 0.9599 0.9575 0.9455 0.9514 0.9079 0.8965 0.9022 0.9423
2 NLPR-PAL 0.9708 0.9748 0.9728 0.9596 0.9636 0.9616 0.9359 0.9399 0.9379 0.8649 0.8685 0.8667 0.9291
3 Lenovo Ocean 0.9175 0.9021 0.9097 0.9075 0.8923 0.8999 0.8848 0.8699 0.8773 0.8293 0.8154 0.8223 0.8773
4 ABC Fintech 0.8738 0.7846 0.8268 0.8629 0.7748 0.8165 0.8411 0.7552 0.7959 0.7679 0.6895 0.7266 0.7861
5 Applica-robots 0.9032 0.9007 0.9020 0.8836 0.8811 0.8824 0.8261 0.8238 0.8249 0.5456 0.5441 0.5448 0.7697
6 Table Fan 0.9040 0.8825 0.8931 0.8754 0.8545 0.8648 0.8152 0.7958 0.8054 0.5845 0.5706 0.5775 0.7684
7 TJNU202-2 0.9586 0.9077 0.9325 0.9409 0.8909 0.9152 0.8626 0.8168 0.8391 0.4889 0.4629 0.4756 0.7665
8 Cinners-table 0.7736 0.6979 0.7338 0.7411 0.6685 0.7029 0.7085 0.6392 0.6721 0.6279 0.5664 0.5956 0.6687
9 Clova AI 0.6384 0.8937 0.7448 0.6024 0.8434 0.7028 0.4835 0.6769 0.5641 0.2228 0.3119 0.2599 0.5413
10 HCL IDORAN 0.4305 0.5371 0.4779 0.4058 0.5063 0.4505 0.3341 0.4168 0.3709 0.2040 0.2545 0.2265 0.3676
11 AIRL 0.1740 0.2224 0.1952 0.1335 0.1706 0.1498 0.0853 0.1091 0.0958 0.0460 0.0587 0.0516 0.1150

Results for track A, archival dataset


Rank Team IoU@0.6 IoU@0.7 IoU@0.8 IoU@0.9 WAvg. F1
Precision Recall F1 Precision Recall F1 Precision Recall F1 Precision Recall F1
1 TableRadar 0.9772 0.9662 0.9716 0.9696 0.9586 0.9641 0.9582 0.9474 0.9527 0.9163 0.9060 0.9112 0.9467
2 NLPR-PAL 0.9624 0.9624 0.9624 0.9549 0.9549 0.9549 0.9361 0.9361 0.9361 0.8947 0.8947 0.8947 0.9333
3 Lenovo Ocean 0.9572 0.9248 0.9407 0.9533 0.9211 0.9369 0.9300 0.8985 0.9140 0.8755 0.8459 0.8604 0.9086
4 TJNU202-2 0.9768 0.9511 0.9638 0.9653 0.9398 0.9524 0.9382 0.9135 0.9257 0.6486 0.6316 0.6400 0.8538
5 Applica-robots 0.9423 0.9211 0.9316 0.9308 0.9098 0.9202 0.8808 0.8609 0.8707 0.6385 0.6241 0.6312 0.8226
6 Cinners-table 0.7225 0.6165 0.6653 0.7093 0.6053 0.6531 0.6872 0.5865 0.6329 0.6696 0.5714 0.6166 0.6392
7 Table Fan 0.8269 0.8083 0.8175 0.7769 0.7594 0.7681 0.6731 0.6579 0.6654 0.3654 0.3571 0.3612 0.6285
8 ABC Fintech 0.7178 0.5451 0.6197 0.7129 0.5414 0.6154 0.6881 0.5226 0.5940 0.5990 0.4549 0.5171 0.5811
9 Clova AI 0.6396 0.8872 0.7433 0.6070 0.8421 0.7055 0.5122 0.7105 0.5953 0.3117 0.4323 0.3622 0.5807
10 HCL IDORAN 0.3609 0.4436 0.3980 0.3547 0.4361 0.3912 0.3211 0.3947 0.3541 0.2569 0.3158 0.2833 0.3503
11 AIRL 0.2186 0.4586 0.2961 0.1720 0.3609 0.2330 0.1057 0.2218 0.1432 0.0538 0.1128 0.0728 0.1736

Results for track A, modern dataset


Rank Team IoU@0.6 IoU@0.7 IoU@0.8 IoU@0.9 WAvg. F1
Precision Recall F1 Precision Recall F1 Precision Recall F1 Precision Recall F1
1 TableRadar 0.9752 0.9621 0.9686 0.9639 0.9510 0.9574 0.9571 0.9443 0.9507 0.9029 0.8909 0.8969 0.9397
2 NLPR-PAL 0.9757 0.9822 0.9789 0.9624 0.9688 0.9656 0.9358 0.9421 0.9390 0.8473 0.8530 0.8502 0.9265
3 ABC Fintech 0.9455 0.9265 0.9359 0.9318 0.9131 0.9224 0.9114 0.8931 0.9021 0.8455 0.8285 0.8369 0.8940
4 Lenovo Ocean 0.8946 0.8886 0.8916 0.8812 0.8753 0.8782 0.8587 0.8530 0.8559 0.8027 0.7973 0.8000 0.8515
5 Table Fan 0.9498 0.9265 0.9380 0.9338 0.9109 0.9222 0.8995 0.8775 0.8884 0.7146 0.6971 0.7057 0.8514
6 Applica-robots 0.8808 0.8886 0.8847 0.8565 0.8641 0.8603 0.7947 0.8018 0.7982 0.4923 0.4967 0.4945 0.7389
7 TJNU202-2 0.9474 0.8820 0.9135 0.9258 0.8619 0.8927 0.8158 0.7595 0.7866 0.3900 0.3630 0.3760 0.7136
8 Cinners-table 0.8014 0.7461 0.7728 0.7584 0.7060 0.7313 0.7201 0.6704 0.6943 0.6053 0.5635 0.5836 0.6854
9 Clova AI 0.6377 0.8976 0.7456 0.5997 0.8441 0.7012 0.4668 0.6570 0.5458 0.1709 0.2405 0.1998 0.5182
10 HCL IDORAN 0.4708 0.5924 0.5247 0.4354 0.5479 0.4852 0.3416 0.4298 0.3807 0.1735 0.2183 0.1933 0.3776
11 AIRL 0.1039 0.0824 0.0919 0.0730 0.0579 0.0646 0.0534 0.0423 0.0472 0.0337 0.0267 0.0298 0.0550

Results for track B


Team:
NLPR-PAL		 IoU@0.6 IoU@0.7 IoU@0.8 IoU@0.9 WAvg. F1
Precision Recall F1 Precision Recall F1 Precision Recall F1 Precision Recall F1
Track B1 0.7146 0.7757 0.7439 0.6595 0.7158 0.6865 0.4876 0.5292 0.5076 0.1289 0.1399 0.1342 0.4846
Track B2 - combined 0.6845 0.7451 0.7135 0.6200 0.6750 0.6463 0.4411 0.4802 0.4598 0.1195 0.1301 0.1246 0.4535
Track B2 - archival 0.7212 0.7721 0.7458 0.6557 0.7020 0.6780 0.4684 0.5015 0.4844 0.1286 0.1286 0.1329 0.4764
Track B2 - modern 0.3224 0.4206 0.3650 0.2690 0.3509 0.3046 0.1722 0.2246 0.1950 0.0305 0.0397 0.0345 0.2064

Team: HCL IDORAN
 IoU@0.6 IoU@0.7 IoU@0.8 IoU@0.9 WAvg. F1
Precision Recall F1 Precision Recall F1 Precision Recall F1 Precision Recall F1
Track B1 0.2519 0.0491 0.0822 0.2306 0.0449 0.0752 0.2025 0.0394 0.0660 0.1199 0.0234 0.0391 0.0633
Track B2 - combined 0.0905 0.0171 0.0288 0.0808 0.0153 0.0257 0.0644 0.0153 0.0257 0.0419 0.0079 0.0133 0.0226
Track B2 - archival 0.1198 0.0184 0.0319 0.1071 0.0165 0.0286 0.0855 0.0132 0.0228 0.0556 0.0086 0.0148 0.0236
Track B2 - modern 0.0017 0.0010 0.0013 0.0012 0.0007 0.0009 0.0003 0.0002 0.0002 0.0001 8E-5 9E-5 3E-4

Participants

Team Institution Team Members
ABC Fintech ABC Fintech Chen Chen, Chao Cui, Song Jin, Meng Guo, Manye Yang
Applica-robots Applica.ai Paweł Dyda, Anna Wróblewska, Przemysław Lipka, Tomasz Stanisławek
AIRL Al-Khawarizmi Institute of Computer Science, University of Engineering and Technology, Lahore, Pakistan Sheikh Faisal Rashid, Masooma Zia
Cinners-table R&D department, Cinnamon AI labs Tran Tuan Anh, Pham Qui Luan, Nguyen Quoc Thang
Clova AI NAVER Kim Seonghyeon
HCL IDORAN HCL Dhev, Bhaskar, Sarath, Dinesh, Gokul
Lenovo Ocean Lenovo Research Hui Li, Chendi Zang, Wangjun Lv, Luyan Wang, Yaqiang Wu
NLPR-PAL Institute of Automation of Chinese Academy of Sciences Xiaohui Li, Fei Yin, Chenglin Liu
Table Fan Individual Yibo Li
Table Radar CCi Intelligence Co., Ltd. Fengjun Guo, Zhuyan Zhang
TJNU202-2 Tianjin Normal University Yuanping Zhu, Ningning Sun