Skip to content

Commit 52924ea

Browse files
committed
refactor: added new profiling setup to the profiling tutorial's config
1 parent 37b25d8 commit 52924ea

1 file changed

Lines changed: 20 additions & 1 deletion

File tree

tutorials/profiling/configs/distributed_8B_model_profiling.yaml

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,26 @@ settings:
66
benchmark:
77
sequence_length: 4096
88
vocab_size: 50304
9-
batch_size: 2
9+
batch_size: 1
10+
paths:
11+
experiment_root_path: ${modalities_env:config_folder_path}
12+
13+
profiler:
14+
component_key: steppable_profiler
15+
variant_key: kernel_tracing
16+
config:
17+
num_wait_steps: 5
18+
num_warmup_steps: 5
19+
num_active_steps: 3
20+
profiler_activities: [CPU, CUDA]
21+
record_shapes: false
22+
profile_memory: false
23+
with_stack: false
24+
with_flops: false
25+
with_modules: false
26+
tracked_ranks: [0, 1]
27+
output_folder_path: ${settings.paths.experiment_root_path}/kernel_traces
28+
1029

1130
steppable_component:
1231
component_key: steppable_component

0 commit comments

Comments
 (0)