Skip to content

Migrate GLT DistServer to GiGL.#476

Draft
kmontemayor2-sc wants to merge 5 commits intomainfrom
kmonte/migrate-glt-dist-server
Draft

Migrate GLT DistServer to GiGL.#476
kmontemayor2-sc wants to merge 5 commits intomainfrom
kmonte/migrate-glt-dist-server

Conversation

@kmontemayor2-sc
Copy link
Collaborator

Scope of work done

We need to do this as for GraphStore mode we need to initiate the sampling producers on the servers, which has been done inside the GLT dist_loader 1, but since we have our own sampling producer with ABLP logic 2, we need to call that producer.

Ultimately the DistServer is responsible for instantiating the producer 3 so we need to have our own server.

Also rename our DistSamplingProducer -> DistAblpSamplingProducer to clarify (I was getting confused as the two names are very similar otherwise).

I'll have a follow-up to migrate the storage_utils stuff to this class :)

I do have an MVP for the ablp loader with graph store - see #475

Where is the documentation for this feature?: N/A

Did you add automated tests or write a test plan?

Updated Changelog.md? NO

Ready for code review?: NO

Copy link
Collaborator

@mkolodner-sc mkolodner-sc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Kyle! Generally LGTM, as we are primarily just migrating code from GLT IIUC.

from gigl.distributed.dist_context import DistributedContext
from gigl.distributed.dist_dataset import DistDataset
from gigl.distributed.dist_sampling_producer import DistSamplingProducer
from gigl.distributed.dist_sampling_producer import DistAblpSamplingProducer
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: DistAblpSamplingProducer -> DistABLPSamplingProducer I believe we've taken this approach with existing ABLP classnames [1].

Ditto elsewhere



# TODO(kmonte): Migrate graph_store/storage_utils to this class.
class DistServer(object):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might come off as a generic DistServer that can be used, when in reality its only practical for the ABLP use case right? We should probably name it as such

@kmontemayor2-sc
Copy link
Collaborator Author

/integration_test

@kmontemayor2-sc
Copy link
Collaborator Author

/e2e_test

@github-actions
Copy link
Contributor

github-actions bot commented Feb 6, 2026

GiGL Automation

@ 23:47:23UTC : 🔄 Integration Test started.

@ 24:55:30UTC : ✅ Workflow completed successfully.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 6, 2026

GiGL Automation

@ 23:47:29UTC : 🔄 E2E Test started.

@ 01:14:59UTC : ✅ Workflow completed successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants