Skip to content

add cgns and ensight etl tutorials#45

Open
Ira-Shokar wants to merge 1 commit intoNVIDIA:mainfrom
Ira-Shokar:main
Open

add cgns and ensight etl tutorials#45
Ira-Shokar wants to merge 1 commit intoNVIDIA:mainfrom
Ira-Shokar:main

Conversation

@Ira-Shokar
Copy link

  • Add tutorials for PhysicsNeMo-Curator with CGNS and Ensight Gold

These tutorial explain how to use PhysicsNeMo-Curator for preparing datasets from Ensight Gold and CGNS, detailing the ETL process, prerequisites, pipeline components, usage guide, output structure, and adaptation for real data files.

@Ira-Shokar Ira-Shokar marked this pull request as draft December 22, 2025 16:26
@Ira-Shokar Ira-Shokar marked this pull request as ready for review December 22, 2025 16:27
@coreyjadams
Copy link
Collaborator

Hi @Ira-Shokar - As you may or may not be aware, our maintainer for curator has left and I'm stepping in for now. So I'll be your reviewer for this :)

I haven't run the code yet - I will try to do so - but, I can see there is a good bit of duplication. Can we consolidate this to two folders instead of 4, and make sure there is minimal duplication of code?

raise ValueError(f"Failed to read CGNS file: {filepath}")

# Extract surface and triangulate
surface_mesh = original_mesh.extract_surface().triangulate()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems like this is tightly configured only for handling surface meshes. Volume mesh will not need extract_surface and triangulate methods.

from physicsnemo_curator.etl.processing_config import ProcessingConfig


class CGNSDataSource(DataSource):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems like this class is common across several examples. Should this be moved into the curator source code? @coreyjadams @ram-cherukuri

from physicsnemo_curator.etl.processing_config import ProcessingConfig


class CGNSToZarrTransformation(DataTransformation):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add support for global parameters like the domino example that @ns5678 has written

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants