Commit 4ea0c2f
Adding returnKVTensorMetaData flag to Staging Read Strategy (#5200)
Summary:
X-link: facebookresearch/FBGEMM#2196
**Context:**
When using SSD Offloaded Tensors during Training, we create a Partially Materialized Tensor (i.e., tensor-like) structure to be used for post-training (checkpointing and publishing)
In this diff, we add a new flag "returnKVTensorMetaData" to the Staging Read Strategy, which helps us to read only the metadata of the KVTensor and not the KVTensor itself
Reviewed By: chunzhao
Differential Revision: D866340841 parent 055dbbc commit 4ea0c2f
File tree
2 files changed
+10
-0
lines changed- fbgemm_gpu/src/ssd_split_embeddings_cache
2 files changed
+10
-0
lines changedLines changed: 6 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
108 | 108 | | |
109 | 109 | | |
110 | 110 | | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
111 | 117 | | |
Lines changed: 4 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
415 | 415 | | |
416 | 416 | | |
417 | 417 | | |
| 418 | + | |
| 419 | + | |
| 420 | + | |
| 421 | + | |
418 | 422 | | |
419 | 423 | | |
420 | 424 | | |
| |||
0 commit comments