ICDAR 2017 Page Object Detection Competition

Organizers

The ICDAR2017 Page Ojbect Detection(POD) competition is end. During the competition, we have received 13 regisrations of different teams and finally there are 8 teams submitted their results.

The results on different evaluation metrics(F1,mean Average Precisions(mAPs) with IOU=0.6 and 0.8) is shown as follows. Many thanks to the participants.

PS: Team isctpku with '*' participates the competition informally, which not counts in the rank.

Task D: Page Object Detection

IOU = 0.8

F1						mAPs
Rank	Team	Formula F1	Table F1	Figure F1	Ave F1	Rank	Team	Formula AP	Table AP	Figure AP	mAPs
1	PAL	0.902	0.951	0.898	0.917	1	PAL	0.816	0.911	0.805	0.844
*	icstpku	0.841	0.763	0.708	0.770	*	icstpku	0.815	0.697	0.597	0.703
2	FastDetectors	0.639	0.896	0.616	0.717	2	HustVision	0.293	0.796	0.656	0.582
3	Vislnt	0.241	0.826	0.643	0.570	3	FastDetectors	0.427	0.884	0.365	0.559
4	School of Software	0.218	0.796	0.656	0.557	4	Vislnt	0.117	0.795	0.565	0.492
5	UITVN	0.200	0.635	0.619	0.485	5	School of Software	0.109	0.737	0.518	0.455
6	maitai-ee	0.065	0.776	0.357	0.399	6	UITVN	0.061	0.695	0.554	0.437
7	HustVision	0.042	0.115	0.132	0.096	7	maitai-ee	0.005	0.626	0.134	0.255

IOU = 0.6

F1						mAPs
Rank	Team	Formula F1	Table F1	Figure F1	Ave F1	Rank	Team	Formula AP	Table AP	Figure AP	mAPs
1	PAL	0.915	0.960	0.927	0.934	1	HustVision	0.854	0.938	0.853	0.882
*	icstpku	0.859	0.813	0.763	0.811	2	PAL	0.839	0.933	0.849	0.874
2	School of Software	0.604	0.937	0.847	0.796	*	icstpku	0.849	0.753	0.679	0.760
3	Vislnt	0.605	0.921	0.824	0.783	3	School of Software	0.537	0.931	0.785	0.751
4	FastDetectors	0.675	0.921	0.638	0.745	4	Vislnt	0.524	0.914	0.781	0.740
5	UITVN	0.377	0.782	0.775	0.645	5	UITVN	0.193	0.924	0.786	0.634
6	maitai-ee	0.337	0.865	0.562	0.588	6	FastDetectors	0.474	0.925	0.392	0.597
7	HustVision	0.078	0.132	0.164	0.124	7	maitai-ee	0.116	0.781	0.325	0.407

Task A: Formula Detection

IOU = 0.8

F1					mAPs
Rank	Team	Presicion	Recall	F1	Rank	Team	AP
1	PAL	0.888	0.916	0.902	1	PAL	0.816
*	icstpku	0.819	0.864	0.841	*	icstpku	0.815
2	FastDetectors	0.744	0.560	0.639	2	FastDetectors	0.427
3	Vislnt	0.223	0.261	0.241	3	HustVision	0.293
4	School of Software	0.202	0.238	0.218	4	Vislnt	0.117
5	UITVN	0.155	0.283	0.200	5	School of Software	0.109
6	maitai-ee	0.079	0.055	0.065	6	UITVN	0.061
7	HustVision	0.022	0.482	0.042	7	maitai-ee	0.005

IOU = 0.6

F1					mAPs
Rank	Team	Presicion	Recall	F1	Rank	Team	AP
1	PAL	0.901	0.929	0.915	1	HustVision	0.854
*	icstpku	0.836	0.883	0.859	*	icstpku	0.849
2	FastDetectors	0.786	0.591	0.675	2	PAL	0.839
3	Vislnt	0.561	0.657	0.605	3	School of Software	0.537
4	School of Software	0.558	0.657	0.604	4	Vislnt	0.524
5	UITVN	0.292	0.533	0.377	5	FastDetectors	0.474
6	maitai-ee	0.409	0.287	0.337	6	UITVN	0.193
7	HustVision	0.041	0.899	0.078	7	maitai-ee	0.116

Task B: Table Detection

IOU = 0.8

F1					mAPs
Rank	Team	Presicion	Recall	F1	Rank	Team	AP
1	PAL	0.958	0.943	0.951	1	PAL	0.911
2	FastDetectors	0.879	0.915	0.896	2	FastDetectors	0.884
3	Vislnt	0.829	0.823	0.826	3	HustVision	0.796
4	School of Software	0.793	0.798	0.796	4	Vislnt	0.795
5	maitai-ee	0.755	0.798	0.776	5	School of Software	0.737
*	icstpku	0.804	0.726	0.763	*	icstpku	0.697
6	UITVN	0.544	0.763	0.635	6	UITVN	0.695
7	IU-vision	0.118	0.114	0.116	7	maitai-ee	0.626
8	HustVision	0.062	0.836	0.115	8	IU-vision	0.015

IOU = 0.6

F1					mAPs
Rank	Team	Presicion	Recall	F1	Rank	Team	AP
1	PAL	0.968	0.953	0.960	1	HustVision	0.938
2	School of Software	0.934	0.940	0.937	2	PAL	0.933
3	FastDetectors	0.903	0.940	0.921	3	School of Software	0.931
4	Vislnt	0.924	0.918	0.921	4	FastDetectors	0.925
5	maitai-ee	0.842	0.890	0.865	5	UITVN	0.924
*	icstpku	0.857	0.773	0.813	6	Vislnt	0.914
6	UITVN	0.670	0.940	0.782	7	maitai-ee	0.781
7	IU-vision	0.230	0.221	0.225	*	icstpku	0.753
8	HustVision	0.071	0.959	0.132	8	IU-vision	0.080

Task C: Figure Detection

IOU = 0.8

F1					mAPs
Rank	Team	Presicion	Recall	F1	Rank	Team	AP
1	PAL	0.892	0.904	0.898	1	PAL	0.805
*	icstpku	0.720	0.696	0.708	2	HustVision	0.656
2	School of Software	0.667	0.645	0.656	*	icstpku	0.597
3	Vislnt	0.654	0.631	0.643	3	Vislnt	0.565
4	UITVN	0.575	0.671	0.619	4	UITVN	0.554
5	FastDetectors	0.734	0.531	0.616	5	School of Software	0.518
6	maitai-ee	0.455	0.294	0.357	6	FastDetectors	0.365
7	IU-vision	0.296	0.280	0.288	7	maitai-ee	0.134
8	HustVision	0.073	0.709	0.132	8	IU-vision	0.081

IOU = 0.6

F1					mAPs
Rank	Team	Presicion	Recall	F1	Rank	Team	AP
1	PAL	0.920	0.933	0.927	1	HustVision	0.853
2	School of Software	0.862	0.833	0.847	2	PAL	0.849
3	Vislnt	0.839	0.810	0.824	3	UITVN	0.786
4	UITVN	0.719	0.840	0.775	4	School of Software	0.785
*	icstpku	0.776	0.749	0.763	5	Vislnt	0.781
5	FastDetectors	0.759	0.549	0.638	*	icstpku	0.679
6	IU-vision	0.625	0.590	0.607	6	IU-vision	0.415
7	maitai-ee	0.717	0.462	0.562	7	FastDetectors	0.392
8	HustVision	0.090	0.881	0.164	8	maitai-ee	0.325

ICDAR 2017 POD Competition

Task D: Page Object Detection

IOU = 0.8

IOU = 0.6

Task A: Formula Detection

IOU = 0.8

IOU = 0.6

Task B: Table Detection

IOU = 0.8

IOU = 0.6

Task C: Figure Detection

IOU = 0.8

IOU = 0.6