Rank | Institution | Model name | FPS | Hardware | PQ | PQth | PQst | RQ | SQ | F1 |
---|---|---|---|---|---|---|---|---|---|---|
1 | UL FRI | PanSR (Swin-L) | 0.7 | RTX A4500 | 57.3 | 43.0 | 95.4 | 66.9 | 75.9 | 80.3 |
2 | UL FRI | PanSR (RN-50) | 1.3 | RTX A4500 | 54.2 | 39.3 | 94.1 | 63.9 | 82.6 | 63.1 |
3 | Fraunhofer IOSB - BIG | MaskDINO | 1.0 | V100 | 53.9 | 39.4 | 92.3 | 63.3 | 75.2 | 76.5 |
4 | GIST AI Lab | PanopticWaterFormer | 1.1 | H100 | 53.0 | 37.3 | 94.7 | 61.6 | 75.7 | 84.4 |
5 | GIST AI Lab | PanopticWaterFormer | 1.1 | H100 | 52.6 | 36.8 | 94.7 | 61.1 | 75.7 | 84.4 |
6 | Fraunhofer IOSB - BIG | mASK-DINO | 0.1 | V100 | 52.1 | 37.0 | 92.3 | 61.0 | 75.2 | 76.5 |
7 | University of Ljubljana | FC-CLIP-CNL-COCO-FT | 10 | A100 | 49.7 | 32.4 | 95.6 | 58.4 | 74.0 | 76.6 |
8 | WaterScenes | WaterScenes | 10 | 4090 | 48.6 | 31.2 | 95.1 | 57.1 | 74.0 | 74.0 |
9 | GIST AI Lab | PanopticWaterFormer | 1.1 | H100 | 48.1 | 30.5 | 95.0 | 56.1 | 74.3 | 83.2 |
10 | YCIT | SeeDroneSee | 4.8 | H100 | 47.7 | 30.0 | 95.0 | 56.1 | 73.7 | 73.8 |
11 | xjtlu | mask | 1.7 | 3090 | 47.4 | 29.5 | 94.9 | 55.6 | 73.5 | 72.4 |
12 | WaterScenes | WaterScenes | 10 | 4090 | 46.5 | 28.3 | 94.9 | 54.8 | 73.0 | 71.7 |
13 | University of Ljubljana | PSAM | 0.6 | 2080 Ti | 46.2 | 28.9 | 92.1 | 54.6 | 72.7 | 77.8 |
14 | XJTLU | SeeDroneSee | 3.8 | H100 | 44.8 | 26.1 | 94.8 | 52.5 | 73.0 | 73.2 |
15 | WaterScenes | WaterScenes | 30 | 4090 | 43.8 | 24.6 | 94.8 | 51.1 | 73.3 | 73.9 |
16 | WaterScenes | WaterScenes | 30 | 4090 | 41.4 | 22.3 | 92.5 | 47.1 | 75.2 | 60.9 |
17 | UL FRI | Mask2Former (Swin-B) | 4.8 | V100 | 41.4 | 22.3 | 92.5 | 47.1 | 75.2 | 60.9 |
18 | WaterScenes | WaterScenes | 30 | 4090 | 40.7 | 20.5 | 94.4 | 47.2 | 72.5 | 68.5 |
19 | University of Ljubljana | Panoptic FPN (RN-50) | 21.7 | V100 | 40.1 | 21.7 | 89.3 | 46.9 | 73.5 | 58.9 |
20 | WaterScenes | WaterScenes | 30 | 4090 | 40.1 | 19.8 | 94.3 | 46.5 | 72.3 | 68.0 |
21 | University of Ljubljana | Mask2Former (Swin-T) | 5.4 | V100 | 39.2 | 18.8 | 93.7 | 45.5 | 72.2 | 56.7 |
22 | University of Ljubljana | Panoptic FPN (RN-101) | 16.7 | V100 | 38.7 | 19.7 | 89.4 | 45.0 | 73.6 | 58.1 |
23 | GIST AI Lab | Baseline | 9.6 | H100 | 38.4 | 17.2 | 94.7 | 44.8 | 70.4 | 60.2 |
24 | University of Ljubljana | Mask2Former (RN-50) | 10.6 | V100 | 37.6 | 17.0 | 92.4 | 43.7 | 71.3 | 54.9 |
25 | WaterScenes | WaterScenes | 30 | 4090 | 37.4 | 16.1 | 94.2 | 42.7 | 72.8 | 69.2 |
26 | University of Ljubljana | Mask2Former (RN-101) | 5.7 | V100 | 37.2 | 16.3 | 92.8 | 43.0 | 71.4 | 53.2 |
27 | University of Ljubljana | Panoptic Deeplab (RN-50) | 6.0 | V100 | 34.7 | 13.4 | 91.4 | 40.3 | 69.5 | 64.6 |
28 | WaterScenes | WaterScenes | 30 | 4090 | 34.6 | 12.0 | 94.8 | 39.0 | 71.6 | 68.1 |
29 | University of Ljubljana | MaX-DeepLab (MaX-S) | 3.7 | V100 | 31.9 | 9.5 | 91.7 | 36.1 | 71.3 | 60.2 |
30 | WaterScenes | WaterScenes | 30 | 4090 | 28.6 | 4.1 | 93.9 | 31.0 | 56.1 | 40.9 |
31 | WaterScenes | WaterScenes | 30 | 4090 | 25.5 | 1.2 | 90.5 | 27.3 | 32.4 | 47.7 |