Leaderboard

Competition Rules

For training the model, use only training set do not use validation and test sets.

The organizers request the team to upload the final/updated trained model, inference code, ReadMe file, and algorithm details on the competition website on or before 10th April. If there is a mismatch between the results uploaded, the trained model submitted and the results obtained by the inference code by the team, then the team will not be allowed to continue the competition. In such a case, the team results will not be displayed on the leaderboard.

Please note that the most recent submission at the time of competition close date would be considered as the final submission. As per the competition rules, picking up the best model would be considered as cherry picking.

Final Submissions and Ranks

Team Category 1: Avg Category 2: Avg Category 3: Avg Category 4: Avg Category 5: Avg All Categories: Avg Weighted Categories Average (Final Score) Rank
BASELINE 0.281 0.091 0.096 0.2 0.169 0.168 0.163 N/A
UPSTAGE 0.963 0.942 0.953 0.974 0.956 0.957 0.959 1 (Winner)
NII-TABIQA 0.932 0.876 0.855 0.895 0.931 0.898 0.901 2 (Runner-up)
DEEPSE-X-UPSTAGE-HK 0.939 0.874 0.859 0.902 0.858 0.886 0.879 3
BD-VQA 0.799 0.794 0.729 0.736 0.422 0.696 0.64 4
SFANC57 0.648 0.119 0.132 0.463 0.418 0.356 0.359 6

All Sumbissions (sorted by submission timestamp)

Date Team Category 1: Avg Category 2: Avg Category 3: Avg Category 4: Avg Category 5: Avg All Categories: Avg Weighted Categories Average (Final Score)
N/A BASELINE 0.281 0.091 0.096 0.2 0.169 0.168 0.163
2023-04-10 15:09:05.415673 UPSTAGE 0.963 0.942 0.953 0.974 0.956 0.957 0.959
2023-04-10 12:06:41.512469 DEEPSE-X-UPSTAGE-HK 0.939 0.874 0.859 0.902 0.858 0.886 0.879
2023-04-09 14:50:07.743286 SFANC57 0.648 0.119 0.132 0.463 0.418 0.356 0.359
2023-04-09 14:37:00.348252 NII-TABIQA 0.932 0.876 0.855 0.895 0.931 0.898 0.901
2023-04-09 06:36:25.346105 BD-VQA 0.799 0.794 0.729 0.736 0.422 0.696 0.64
2023-04-08 17:35:14.786735 BD-VQA 0.799 0.792 0.728 0.734 0.419 0.695 0.638
2023-04-05 03:18:29.661807 BD-VQA 0.799 0.792 0.604 0.734 0.385 0.663 0.605
2023-04-04 17:43:27.467310 BD-VQA 0.799 0.768 0.57 0.707 0.364 0.642 0.581
2023-04-03 23:20:03.344453 NII-TABIQA 0.931 0.872 0.854 0.892 0.928 0.895 0.898
2023-03-29 10:37:53.548661 BD-VQA 0.359 0.106 0.117 0.256 0.223 0.212 0.209
2023-03-28 09:29:39.004988 NII-TABIQA 0.932 0.871 0.853 0.894 0.93 0.896 0.899
2023-03-27 08:12:54.804137 DEEPSE-X-UPSTAGE-HK 0.934 0.732 0.672 0.766 0.646 0.75 0.718
2023-03-26 16:25:37.384604 NII-TABIQA 0.932 0.863 0.846 0.894 0.929 0.893 0.897
2023-03-26 16:25:10.823493 NII-TABIQA 0.932 0.86 0.844 0.894 0.928 0.892 0.896
2023-03-26 16:23:09.320752 NII-TABIQA 0.918 0.806 0.787 0.843 0.87 0.845 0.844
2023-03-24 18:41:59.763861 IDV 0.51 0.649 0.509 0.467 0.464 0.52 0.502
2023-03-24 18:41:26.463992 IDV 0.492 0.647 0.52 0.468 0.464 0.518 0.503
2023-03-24 18:39:40.304625 IDV 0.506 0.649 0.51 0.471 0.459 0.519 0.501
2023-03-24 18:35:42.015096 IDV 0.415 0.519 0.467 0.307 0.213 0.384 0.341
2023-03-24 08:16:33.709819 UPSTAGE 0.962 0.94 0.953 0.976 0.958 0.958 0.96
2023-03-22 05:49:37.655041 DEEPSE-X-UPSTAGE-HK 0.933 0.864 0.848 0.881 0.836 0.872 0.862
2023-03-21 15:34:41.163088 UPSTAGE 0.958 0.922 0.922 0.901 0.888 0.918 0.908
2023-03-20 11:55:52.950866 UPSTAGE 0.932 0.893 0.888 0.87 0.85 0.887 0.875
2023-03-20 06:43:25.603829 NII-TABIQA 0.919 0.808 0.79 0.848 0.88 0.849 0.85
2023-03-20 06:42:37.630894 NII-TABIQA 0.917 0.803 0.783 0.846 0.874 0.845 0.845
2023-03-20 05:17:49.092434 NII-TABIQA 0.906 0.809 0.789 0.851 0.884 0.848 0.851
2023-03-18 21:17:08.357854 IDV 0.299 0.429 0.362 0.278 0.255 0.325 0.307
2023-03-16 16:34:39.080786 IDV 0.294 0.407 0.344 0.269 0.245 0.312 0.295