Dataset Root Dir

[shuqi-Deng]

Dear Author:
  Sorry for disturbing.I already fellow your readme in preprocess_code to revise the paths in options.py
  But when I run bash generate_hm3d_train.sh,I came across some errors about my Dataset's root dir.So I wonder if you wrote your root dir in other py files or Dataset Configs.I can't really find the reason.Looking forward to your reply!

[thucz]

The root_dir of generate_hm3d_train.sh is set in here to save processed data. The paths in options.py is the original raw data of the HM3D datasets.

[shuqi-Deng]

It seems that the error occurs in Multi-process when using simulator.I wonder did you revise the config of Habitat Sim?

[thucz]

Hi! Try to remove preprocess/data_readers/scene_episodes/hm3d_train and preprocess/data_readers/scene_episodes/hm3d_test and generate your own json file again. They save the my own cache data directories.

{"episodes": [{"episode_id": "0", "scene_id": "/wudang_vuc_3dc_afs/chenzheng/dataset/hm3d/val/00859-3t8DB4Uzvkt/3t8DB4Uzvkt.basis.glb", "scene_dataset_config": "default", "additional_obj_config_paths": [], "start_position": [4.9722137451171875, 2.7564451694488525, -4.373941898345947], "start_rotation": [0, 0.5933696821796376, 0, -0.8049300716646359], "info": {"geodesic_distance": 8.820812225341797}, "goals": [{"position": [7.360230445861816, 2.7564451694488525, 2.521066188812256], "radius": 0.2}], "start_room": null, "shortest_paths": null}, {"episode_id": "0", "scene_id": "/wudang_vuc_3dc_afs/chenzheng/dataset/hm3d/val/00877-4ok3usBNeis/4ok3usBNeis.basis.glb", "scene_dataset_config": "default", "additional_obj_config_paths": []......

[shuqi-Deng]

I advise you to revise your data folder structure in Readme of the process code.Because it seems to be wrong.My Data folder structure is like following and it works.

Besides,there are some code disabled with comments such as the class of Example.

[shuqi-Deng]

After I run the convert.py,there is no index.json in the result "hm3d_dataset_pt" folder.

And it's required by the evaluation on hm3d.

[thucz]

change these variables in preprocess/generate_index.py according to your paths:

dataset_name = "replica_dataset_pt"
DATASET_PATH = Path("/wudang_vuc_3dc_afs/chenzheng/" + dataset_name + "/")

and run python preprocess/generate_index.py

[BW-Zhang05]

I advise you to revise your data folder structure in Readme of the process code.Because it seems to be wrong.My Data folder structure is like following and it works.

Besides,there are some code disabled with comments such as the class of Example.

Yes， i met the same issue, the structure in Readme seemed wrong