From f00a98bea9bb1441fe6b354f853b3e85f756b02b Mon Sep 17 00:00:00 2001
From: Jiawei Ren <72253125+jiawei-ren@users.noreply.github.com>
Date: Fri, 15 Mar 2024 16:41:51 +0800
Subject: [PATCH] Update README.md
---
README.md | 19 +++++++++++++++----
1 file changed, 15 insertions(+), 4 deletions(-)
diff --git a/README.md b/README.md
index 733a24b..e4be069 100644
--- a/README.md
+++ b/README.md
@@ -53,7 +53,7 @@ Visit our project
## Updates
-
+- \[2024.03\] - We add [Leaderboard](#leaderboard) to this page. We welcome pull requests to submit your results!
- \[2024.01\] - The [toolkit](https://github.com/robodrive-24/toolkit) tailored for [The RoboDrive Challenge](https://robodrive-24.github.io/) has been released. :hammer_and_wrench:
- \[2023.12\] - We are hosting [The RoboDrive Challenge](https://robodrive-24.github.io/) at [ICRA 2024](https://2024.ieee-icra.org/). :blue_car:
- \[2023.03\] - Intend to test the robustness of your 3D perception models on real-world point clouds? Check our recent work, [Robo3D](https://github.com/ldkong1205/Robo3D), a comprehensive suite that enables OoD robustness evaluation of 3D detectors and segmentors on our newly established datasets: `KITTI-C`, `SemanticKITTI-C`, `nuScenes-C`, and `WOD-C`.
@@ -72,6 +72,7 @@ Visit our project
- [Highlight](#highlight)
- [Data Preparation](docs/DATA_PREPARE.md)
- [Getting Started](docs/GET_STARTED.md)
+- [Leaderboard](#leaderboard)
- [Benchmark Results](#benchmark-results)
- [Evaluation](#evaluation)
- [Customize Evaluation](#customize-evaluation)
@@ -85,19 +86,19 @@ Visit our project
## Highlight
#### Corruption Taxonomy
-
+
#### ModelNet-C (Classification)
-
+
#### ShapeNet-C (Part Segmentation)
-
+
## Data Preparation
@@ -107,6 +108,16 @@ Please refer to [DATA_PREPARE.md](docs/DATA_PREPARE.md) for the details to prepa
## Getting Started
Please refer to [GET_STARTED.md](docs/GET_STARTED.md) to learn more usage about this codebase.
+## Leaderboard
+
+| Method | Reference | Augmentation | mCE $\downarrow$ | Clean OA $\uparrow$ |
+| ----------------- | ---------------------------------------------------------- | :--------: | :---: | :------: |
+| EPiC (RPC, WOLFMix)| [Levi et al.](https://openaccess.thecvf.com/content/ICCV2023/papers/Levi_EPiC_Ensemble_of_Partial_Point_Clouds_for_Robust_Classification_ICCV_2023_paper.pdf), ICCV 2023 | Yes | 0.501 | 0.927 |
+| EPiC (PCT)| [Levi et al.](https://openaccess.thecvf.com/content/ICCV2023/papers/Levi_EPiC_Ensemble_of_Partial_Point_Clouds_for_Robust_Classification_ICCV_2023_paper.pdf), ICCV 2023 | No | 0.646 | 0.934 |
+| WOLFMix (GDANet) | [Ren et al.](https://arxiv.org/abs/2202.03377), ICML 2022 | Yes | 0.571 | 0.934 |
+| RPC | [Ren et al.](https://arxiv.org/abs/2202.03377), ICML 2022 | No | 0.863 | 0.930 |
+
+
## Benchmark Results