Skip to content

Commit 2d01264

Browse files
authored
Merge pull request #124 from AI-Hypercomputer/ninggu-patch-README-llama3.1-405b
Update llama3.1-405b 32 node README.md
2 parents 583b37a + ebfcab7 commit 2d01264

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

  • training/a4x/llama3-1-405b/nemo-pretraining-gke/32node-FP8CS-GBS2048/recipe

training/a4x/llama3-1-405b/nemo-pretraining-gke/32node-FP8CS-GBS2048/recipe/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -83,7 +83,7 @@ gcloud container clusters get-credentials $CLUSTER_NAME --region $CLUSTER_REGION
8383

8484
### Configure and submit a pretraining job
8585

86-
#### Using 16 node (64 gpus) fp8 precision
86+
#### Using 32 node (128 gpus) fp8 precision
8787
To execute the job with the default settings, run the following command from
8888
your client:
8989

0 commit comments

Comments
 (0)