Giter Site home page Giter Site logo

xiaoaoran / synlidar Goto Github PK

View Code? Open in Web Editor NEW
121.0 13.0 9.0 21.35 MB

SynLiDAR: Synthetic LiDAR sequential point cloud dataset with point-wise annotations (AAAI2022)

License: MIT License

Python 100.00%
dataset domain-adaptation point-cloud semantic-segmentation

synlidar's Introduction

arXiv

SynLiDAR dataset: Learning From Synthetic LiDAR Sequential Point Cloud

This is official repository of the SynLiDAR dataset. For technical details, please refer to:

Transfer learning from synthetic to real LiDAR point cloud for semantic segmentation (Paper)

Aoran Xiao, Jiaxing Huang, Dayan Guan, Fangneng Zhan, Shijian Lu

News

[2023.Mar.] We released SemanticSTF, an adverse weather point cloud dataset with point-wise annotations for semantic segmentation.
[2022.Sep.28] Check the latest benchmark for UDA of LiDAR segmentation (from SynLiDAR to SemanticKITTI).
[2022.Aug.06] We recommend some projects that use SynLiDAR.
[2021.Dec.01] SynLiDAR is accepted by AAAI 2022!
[2021.Jul.28] SynLiDAR is available for download!

Dataset

SynLiDAR is a large-scale synthetic LiDAR sequential point cloud dataset with point-wise annotations. 13 sequences of LiDAR point cloud with around 20k scans (over 19 billion points and 32 semantic classes) are collected from virtual urban cities, suburban towns, neighborhood, and harbor.

image

image

image

Download

  1. You can download SynLiDAR in Google Drive, we provide:
    -- FullDataset: Full SynLiDAR dataset (about 245GB).
    -- SubDataset: uniformlly downsampled dataset (about 24GB), this is the dataset that we used in Paper. You are recommend to use this smaller dataset for faster experiments.
  2. [BaiduYun](password: p3wm)
  3. You can download SynLiDAR through browser → [DR-NTU]
  4. You can also download through provided python script, this requires installing pyDataverse
pip install pyDataverse
python download.py

Note: For most of sequences, we compressed and split them into multiple small files. Please download them and cat into one file before extraction. E.g. for sequence 01:

cat 01*>01.tar.gz
tar -zxvf 01.tar.gz

The data should organized in the following format:

/SynLiDAR/
  └── 00/
    └── velodyne
      └── 000000.bin
      ├── 000001.bin
      ...
    └── labels
      └── 000000.label
      ├── 000001.label
      ...
  ...
  └── annotations.yaml
  └── read_data.py

We provide class annotations (in 'annotations.yaml') and example python code for reading data (in 'read_data.py').

Citation

If you find our work useful in your research, please consider citing:

@inproceedings{xiao2022transfer,
  title={Transfer learning from synthetic to real LiDAR point cloud for semantic segmentation},
  author={Xiao, Aoran and Huang, Jiaxing and Guan, Dayan and Zhan, Fangneng and Lu, Shijian},
  booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
  volume={36},
  number={3},
  pages={2795--2803},
  year={2022}
}

Projects using SynLiDAR

Here we list some projects from top conferences and journals that use SynLiDAR. Please feel free to leave us messages to add your projects!

  • [NeurIPS2023] Segment Any Point Cloud Sequences by Distilling Vision Foundation Models. [paper] [project]
  • [CVPR2023] 3D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Clouds. [paper] [project]
  • [CVPR2023] Adversarially Masking Synthetic to Mimic Real: Adaptive Noise Injection for Point Cloud Segmentation Adaptation. [paper]
  • [CVPR2023] Single Domain Generalization for LiDAR Semantic Segmentation. [paper]
  • [NeurIPS2022] PolarMix: A General Data Augmentation Technique for LiDAR Point Clouds. [pdf] [project]
  • [ECCV2022] CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentation. [paper] [project]
  • [ECCV2022] GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation. [pdf] [project]

Related Repos

Find our other repos for point cloud understanding!

synlidar's People

Contributors

xiaoaoran avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

synlidar's Issues

Class mapping from index to name

Dear authors,

thank you very much for your very interesting work.
In my actual project I would need to name each class index but, unfortunately, I found it is missing a mapping between class indexes [0, 31] and class names [road, .., table].
Can you please provide the mapping between index-name?

Thank you in advance!

Lidar Pose Missing

Dear @xiaoaoran,

I would like to start by expressing my appreciation for your work. It is interesting and inspires the research community for UDA tasks.

I have downloaded the dataset and found out that the Pose (the transformation matrix between local to global coordinate systems) information regarding the Ego-vehicle/Lidar Sensor is missing. Can you please point me where it is stored?

Thank you.
Looking forward to hearing from you soon.

Source Code for PCT

Thank you for the interesting work.

Would you like to share the code for PCT? Especially, the code for the appearance translation module and the sparsity translation module. Thanks!

Affine transformation matrices

Hi!

thanks for the dataset!
Each sequence is provided in the sensor frame therefore it is impossible to accurately register all the frames. Are you going to provide calibration files with affine transform matrices for registering the frames?

Thanks in advance!

Unreal environments release?

Thank you for the great work and datasets! I'm wondering will you also release all the unreal environments you have created?

Question about the class mapping

Hi, Aoran Xiao.
Firstly, thank you for your brilliant work! I see that you have given an example of class mapping from synlidar to semantickitti. And could you share the YAML file of semanticPOSS with me too? Please help.

Download issue

image
Hello,

Thanks for your awesome work. Now I am trying to download the dataset using the provided download.py.
However, as shown in the above figure, the size of all downloaded subsets could not exceed 5.9 GB, so I want to if there is any constraint on the server or any other things I should check.

Thanks

LiDAR sensor specification

Thank you very much for the interesting work and providing the dataset.

I was wondering, which LiDAR sensor you simulated (if you had a specific selected) when generating the dataset or if you have the specifications (like angles, number of beams , number of points per beam) of the sensor that you simulate.

Thank you very much again.
Best,

Question about the class mapping

Hi, Aoran Xiao. First of all, thank you very much for the previous sharing of the mapping file.
But I have a question. Why is the mapping categories of SemanticPoss in the file inconsistent with the categories given in the paper?

About the dataset used in paper

Hi, Aoran Xiao.
Thank you for your brilliant work.

I see that "-- SubDataset: uniformlly downsampled dataset (about 24GB), this is the dataset that we used in Paper. You are recommend to use this smaller dataset for faster experiments." in readme file.

To fairly compare with your method, I would like to confirm that all the experimental results in your paper "Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentation" use SubDataset?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.