Comments (9)
Hi, Do you get any chance to make the semantic annotation work? I download the annotation from a certain branch and load semantic.glb. However, I was told that there is no semantic annotation.
from habitat-matterport-3dresearch.
@IFICL I have exactly the same question as yours. Did you get semantic annotation finally?
from habitat-matterport-3dresearch.
I got the same problem, is there anyone can help us!
from habitat-matterport-3dresearch.
I want to know the format of following data as well.
313,23694C,"refrigerator cabinet",9
"23694C" looks like the combination of hexadecimals, but cannot figure out what it means.
Also, the last number "9" is incomprehensible.
from habitat-matterport-3dresearch.
hi, could you please tell hwo to make the semantic annotation work? Thanks!
from habitat-matterport-3dresearch.
Hey I have this same question. I am loading the .semantic.glb
file but still getting blank semantic images and the error The active scene does not contain semantic annotations : activeSemanticSceneID_ = 0
.
I am using habiat_sim v0.2.3. Is there anything else I need to be configuring in the settings for semantic image segmentation to work? Currently I am just setting the parameters as follows
settings = default_sim_settings.copy()
settings["seed"] = 5
settings["save_png"] = True
settings["color_sensor"] = True
settings["semantic_sensor"] = True
settings["depth_sensor"] = True
settings["sensor_height"] = 0.5
settings["width"] = 224
settings["height"] = 224
settings["scene"] = "/raid/michaelequi/hm3d_semantics/scene_datasets/hm3d/train/00744-1S7LAXRdDqK/1S7LAXRdDqK.semantic.glb"
from habitat-matterport-3dresearch.
Hey folks, please see the Habitat-Matterport 3D Research Dataset (HM3D) section of Habitat-sim's DATASETS readme for the details and examples.
TL;DR: You need to reference the SceneDataset config files instead of trying to directly load the semantic assets.
For example:
There are different ways to achieve this.
- You can directly set these configuration values in your initialization:
backend_cfg = habitat_sim.SimulatorConfiguration()
backend_cfg.scene_id = "<PATH TO HM3D>/minival/00800-TEEsavR23oF/TEEsavR23oF.basis.glb"
backend_cfg.scene_dataset_config_file = "<PATH TO HM3D>/hm3d_annotated_basis.scene_dataset_config.json"
- You can use the settings utility as @Michael-Equi is doing. However, you need to set the
scene_dataset_config_file
parameter to the scene_dataset.json file path and then thescene
parameter should point to the stage_config.json file. - In Habitat-lab you can set the YAML config parameters. E.g.
SIMULATOR.SCENE_DATASET = "<PATH TO HM3D>/hm3d_annotated_basis.scene_dataset_config.json"
Slightly more details: (see concepts and terminology)
Each Scene is composed of a static Stage asset for RGBD rendering and a second asset with the same geometry, but semantic annotation texture instead. Additionally scenes can contain dynamic objects, lighting, navmeshes, etc... All of these components are joined via the SceneDataset config files. When you directly attempt the load a single asset (e.g. .semantic.glb) the simulator is not able to put all of these components together.
from habitat-matterport-3dresearch.
Hi @aclegg3 and thanks for the quick reply but adding the json file using the line settings["scene_dataset_config_file"] = f"{SCENE_DIR}/scene_datasets/hm3d/hm3d_annotated_basis.scene_dataset_config.json"
results in the following error
Traceback (most recent call last):
File "collect_semantic_images.py", line 99, in <module>
sim, agent = run_sim(scene_path, settings)
File "collect_semantic_images.py", line 30, in run_sim
_sim = habitat_sim.Simulator(_cfg)
File "<attrs generated init habitat_sim.simulator.Simulator>", line 11, in __init__
File "/nfs/kun2/users/michaelequi/miniconda3/envs/habitat/lib/python3.7/site-packages/habitat_sim-0.2.3-py3.7-linux-x86_64.egg/habitat_sim/simulator.py", line 119, in __attrs_post_init__
self.__set_from_config(self.config)
File "/nfs/kun2/users/michaelequi/miniconda3/envs/habitat/lib/python3.7/site-packages/habitat_sim-0.2.3-py3.7-linux-x86_64.egg/habitat_sim/simulator.py", line 270, in __set_from_config
self._config_backend(config)
File "/nfs/kun2/users/michaelequi/miniconda3/envs/habitat/lib/python3.7/site-packages/habitat_sim-0.2.3-py3.7-linux-x86_64.egg/habitat_sim/simulator.py", line 201, in _config_backend
super().__init__(config.sim_cfg, config.metadata_mediator)
RuntimeError: std::bad_cast
from habitat-matterport-3dresearch.
hi, I solved this problem by add the following code to /habitat-lab/habitat/core/env.py
self._config.SIMULATOR.SCENE_DATASET = "<PATH TO HM3D>/hm3d_annotated_basis.scene_dataset_config.json"
hope it works.
from habitat-matterport-3dresearch.
Related Issues (20)
- HM3D semantic annotations? HOT 2
- Unable to obtain Habitat - Matterport 3D Research Dataset HOT 1
- Where is the metadata? HOT 1
- Problems about connection with Matterport3D HOT 3
- Working with Habitat Simulator HOT 1
- Fail to get scene instance data HOT 4
- The difference between hm3d v0.1 and v0.2 HOT 2
- Format mismatch in hm3d-example-semantic-configs-v0.2 HOT 2
- Difference between the format of GLC and Habitat
- Semantic Scene of HM3D
- v2 and v1 of this dataset had no info on region centers. The habitat version of the original matterport data does
- Filter semantic annotation in HM3D dataset
- pointnav task dataset for hm3d v0.2? HOT 1
- Sematic annotation file typo
- Bounding box of the annotations? HOT 1
- How to organize the dataset? HOT 1
- Data download failed, no datasource named hm3d_minival-v0.2 HOT 1
- Scale of topdown views for each floor
- Physical units of scans HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from habitat-matterport-3dresearch.