Skip to content

[crashtracking] Document runtime stacks collection #1410

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
gyuheon0h wants to merge 1 commit into
base: main
Choose a base branch
from
Open

[crashtracking] Document runtime stacks collection #1410

gyuheon0h wants to merge 1 commit into from

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Dec 15, 2025 •
edited
Loading

What does this PR do?

We should document high level motivation and decisions made around runtime stack collection callback registration

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gyuheon0h Graphite App
Copy link
Contributor Author

gyuheon0h commented Dec 15, 2025

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h changed the title General runtime stacks background [crashtracking] Document runtime stacks collection Dec 15, 2025
@codecov-commenter
Copy link

codecov-commenter commented Dec 15, 2025 •
edited
Loading

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.24%. Comparing base (73c675b) to head (59977fb).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1410      +/-   ##
==========================================
+ Coverage   71.16%   71.24%   +0.07%     
==========================================
  Files         403      404       +1     
  Lines       64368    64477     +109     
==========================================
+ Hits        45810    45938     +128     
+ Misses      18558    18539      -19
Components Coverage Δ
libdd-crashtracker 58.95% <ø> (-0.02%) ⬇️
libdd-crashtracker-ffi 16.74% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.81% <ø> (ø)
libdd-data-pipeline-ffi 76.59% <ø> (ø)
libdd-common 81.13% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.95% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.71% <ø> (+0.10%) ⬆️
libdd-profiling 80.69% <ø> (+0.25%) ⬆️
libdd-profiling-ffi 63.41% <ø> (ø)
datadog-sidecar 35.86% <ø> (ø)
datdog-sidecar-ffi 10.79% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.97% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@pr-commenter
Copy link

pr-commenter bot commented Dec 15, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-12-15 19:10:28

Comparing candidate commit 0a8b343 in PR branch gyuheon0h/prof-13287-document-runtime-stacks with baseline commit 13970ff in branch main.

Found 1 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

  • 🟩 execution_time [-206.069ns; -199.629ns] or [-7.863%; -7.617%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.594ms 10.623ms ± 0.015ms 10.622ms ± 0.010ms 10.632ms 10.651ms 10.662ms 10.692ms 0.66% 0.836 1.715 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.621ms; 10.625ms] or [-0.019%; +0.019%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.950ms 3.956ms ± 0.007ms 3.955ms ± 0.001ms 3.956ms 3.959ms 3.965ms 4.053ms 2.49% 11.689 150.869 0.19% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.955ms; 3.957ms] or [-0.026%; +0.026%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.065µs 161.719µs ± 0.233µs 161.688µs ± 0.129µs 161.861µs 162.132µs 162.402µs 162.463µs 0.48% 0.527 0.722 0.14% 0.016µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.686µs; 161.751µs] or [-0.020%; +0.020%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.206µs 3.197µs ± 1.430µs 2.986µs ± 0.034µs 3.021µs 3.659µs 13.788µs 14.956µs 400.81% 7.396 55.744 44.63% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.999µs; 3.395µs] or [-6.201%; +6.201%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.149µs 85.355µs ± 0.255µs 85.326µs ± 0.040µs 85.368µs 85.460µs 85.972µs 88.661µs 3.91% 11.091 139.267 0.30% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.320µs; 85.390µs] or [-0.041%; +0.041%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.378µs 2.418µs ± 0.017µs 2.420µs ± 0.013µs 2.427µs 2.452µs 2.465µs 2.482µs 2.56% 0.706 0.844 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.415µs; 2.420µs] or [-0.099%; +0.099%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.086ns 256.936ns ± 13.177ns 250.820ns ± 2.876ns 262.108ns 285.844ns 298.149ns 302.517ns 20.61% 1.639 1.781 5.12% 0.932ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.110ns; 258.762ns] or [-0.711%; +0.711%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 60.966ms 61.775ms ± 2.351ms 61.492ms ± 0.151ms 61.636ms 61.890ms 77.165ms 83.748ms 36.19% 8.103 65.548 3.80% 0.166ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.449ms; 62.101ms] or [-0.527%; +0.527%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.007µs 5.082µs ± 0.041µs 5.086µs ± 0.041µs 5.103µs 5.144µs 5.145µs 5.147µs 1.20% -0.120 -1.140 0.81% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.076µs; 5.087µs] or [-0.112%; +0.112%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 530.546µs 531.218µs ± 0.456µs 531.130µs ± 0.191µs 531.357µs 531.947µs 532.404µs 535.188µs 0.76% 3.927 27.971 0.09% 0.032µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [531.155µs; 531.281µs] or [-0.012%; +0.012%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 187.179ns 190.731ns ± 1.928ns 190.599ns ± 1.588ns 192.104ns 194.366ns 195.316ns 195.996ns 2.83% 0.509 -0.608 1.01% 0.136ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.464ns; 190.998ns] or [-0.140%; +0.140%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.890µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.912µs 3.916µs 3.917µs 3.917µs 0.16% -2.140 18.635 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255275171.060op/s 255687451.262op/s ± 171606.502op/s 255692994.012op/s ± 91049.883op/s 255778850.241op/s 255894148.179op/s 255967598.777op/s 257055530.931op/s 0.53% 2.173 18.930 0.07% 12134.412op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.258µs 81.277µs ± 0.909µs 81.161µs ± 0.608µs 81.881µs 82.888µs 83.194µs 83.527µs 2.92% 0.193 -0.505 1.12% 0.064µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11972241.393op/s 12305120.628op/s ± 137337.489op/s 12321251.317op/s ± 91776.058op/s 12393532.750op/s 12536149.314op/s 12590977.667op/s 12616948.428op/s 2.40% -0.144 -0.511 1.11% 9711.227op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.452µs 75.086µs ± 0.208µs 75.086µs ± 0.126µs 75.194µs 75.412µs 75.663µs 75.938µs 1.13% 0.515 1.734 0.28% 0.015µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13168686.750op/s 13318078.283op/s ± 36792.518op/s 13318069.900op/s ± 22334.511op/s 13341664.907op/s 13375850.465op/s 13400415.990op/s 13431483.397op/s 0.85% -0.486 1.686 0.28% 2601.624op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.913µs 3.916µs 3.918µs 3.922µs 0.27% -1.225 12.504 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254987952.418op/s 255658978.590op/s ± 188086.808op/s 255664069.425op/s ± 94040.239op/s 255758096.868op/s 255894605.069op/s 255991326.774op/s 257003341.043op/s 0.52% 1.254 12.702 0.07% 13299.746op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.614µs 72.137µs ± 0.192µs 72.133µs ± 0.115µs 72.256µs 72.462µs 72.561µs 72.782µs 0.90% 0.045 0.308 0.27% 0.014µs 1 200
credit_card/is_card_number/378282246310005 throughput 13739686.709op/s 13862625.642op/s ± 36970.504op/s 13863332.873op/s ± 22130.665op/s 13885020.840op/s 13928488.845op/s 13943923.279op/s 13963677.161op/s 0.72% -0.027 0.300 0.27% 2614.209op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.125µs 52.200µs ± 0.103µs 52.187µs ± 0.026µs 52.216µs 52.247µs 52.320µs 53.246µs 2.03% 8.413 77.659 0.20% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18780928.007op/s 19157113.472op/s ± 37286.242op/s 19161828.679op/s ± 9590.530op/s 19170338.215op/s 19178085.202op/s 19182155.264op/s 19184740.457op/s 0.12% -8.360 76.957 0.19% 2636.535op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.693µs 5.857µs ± 0.074µs 5.861µs ± 0.053µs 5.906µs 5.978µs 6.001µs 6.003µs 2.42% -0.063 -0.678 1.26% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 166579934.697op/s 170769106.988op/s ± 2166024.532op/s 170617382.095op/s ± 1535052.127op/s 172424670.136op/s 174326247.124op/s 175618618.862op/s 175668928.789op/s 2.96% 0.114 -0.663 1.27% 153161.064op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.920µs 3.921µs 0.21% -1.491 12.266 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255053897.467op/s 255583974.529op/s ± 189699.252op/s 255579839.139op/s ± 105065.700op/s 255694847.759op/s 255839856.137op/s 255905885.246op/s 256950294.438op/s 0.54% 1.518 12.473 0.07% 13413.763op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.103µs 64.491µs ± 0.218µs 64.424µs ± 0.124µs 64.658µs 64.863µs 65.172µs 65.241µs 1.27% 0.945 0.450 0.34% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15327789.193op/s 15506272.038op/s ± 52280.628op/s 15522281.489op/s ± 30029.682op/s 15545569.907op/s 15567534.375op/s 15581836.927op/s 15600010.920op/s 0.50% -0.929 0.402 0.34% 3696.799op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.390µs 57.577µs ± 0.120µs 57.556µs ± 0.057µs 57.614µs 57.827µs 58.007µs 58.097µs 0.94% 1.593 3.266 0.21% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17212735.763op/s 17368007.561op/s ± 36118.420op/s 17374484.702op/s ± 17085.136op/s 17390230.603op/s 17410409.249op/s 17418788.832op/s 17424619.245op/s 0.29% -1.576 3.197 0.21% 2553.958op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.916µs 3.918µs 3.922µs 0.29% -0.268 5.871 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254968468.600op/s 255674921.587op/s ± 183818.286op/s 255696576.609op/s ± 106077.093op/s 255789949.617op/s 255916102.465op/s 255969594.766op/s 256746398.343op/s 0.41% 0.285 5.938 0.07% 12997.916op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.596µs 54.919µs ± 0.238µs 54.846µs ± 0.119µs 55.047µs 55.362µs 55.738µs 55.933µs 1.98% 1.505 2.813 0.43% 0.017µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17878679.017op/s 18209119.022op/s ± 78308.228op/s 18232999.960op/s ± 39792.450op/s 18266523.486op/s 18297511.556op/s 18307511.466op/s 18316384.136op/s 0.46% -1.473 2.667 0.43% 5537.228op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.131µs 52.189µs ± 0.035µs 52.184µs ± 0.022µs 52.208µs 52.256µs 52.283µs 52.352µs 0.32% 1.207 2.451 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19101546.807op/s 19161146.738op/s ± 12707.178op/s 19162862.373op/s ± 8098.414op/s 19170752.142op/s 19177496.647op/s 19179515.991op/s 19182471.058op/s 0.10% -1.201 2.425 0.07% 898.533op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.696µs 5.854µs ± 0.072µs 5.856µs ± 0.042µs 5.897µs 5.983µs 6.004µs 6.011µs 2.64% 0.058 -0.369 1.23% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 166370831.324op/s 170844690.289op/s ± 2114079.459op/s 170769025.551op/s ± 1234793.416op/s 172207335.201op/s 174586971.154op/s 175540994.954op/s 175565354.898op/s 2.81% 0.003 -0.366 1.23% 149487.992op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255663668.252op/s; 255711234.273op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [81.151µs; 81.403µs] or [-0.155%; +0.155%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12286086.973op/s; 12324154.283op/s] or [-0.155%; +0.155%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.058µs; 75.115µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13312979.194op/s; 13323177.372op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255632911.567op/s; 255685045.612op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.110µs; 72.164µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/378282246310005 throughput [13857501.886op/s; 13867749.399op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.186µs; 52.214µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19151945.958op/s; 19162280.987op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.847µs; 5.867µs] or [-0.176%; +0.176%] None None None
credit_card/is_card_number/x371413321323331 throughput [170468916.819op/s; 171069297.156op/s] or [-0.176%; +0.176%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255557684.038op/s; 255610265.021op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.461µs; 64.521µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15499026.445op/s; 15513517.630op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.561µs; 57.594µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17363001.895op/s; 17373013.227op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255649446.141op/s; 255700397.034op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.886µs; 54.951µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18198266.254op/s; 18219971.789op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.184µs; 52.194µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19159385.646op/s; 19162907.831op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.844µs; 5.864µs] or [-0.172%; +0.172%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [170551699.208op/s; 171137681.370op/s] or [-0.171%; +0.171%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.141µs 533.790µs ± 0.384µs 533.743µs ± 0.231µs 533.989µs 534.448µs 534.681µs 535.728µs 0.37% 1.087 2.586 0.07% 0.027µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1866619.496op/s 1873397.851op/s ± 1347.944op/s 1873559.632op/s ± 811.886op/s 1874338.245op/s 1875277.117op/s 1875584.518op/s 1875675.588op/s 0.11% -1.080 2.549 0.07% 95.314op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.883µs 380.563µs ± 0.401µs 380.512µs ± 0.205µs 380.715µs 381.124µs 381.333µs 383.541µs 0.80% 3.214 19.713 0.11% 0.028µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2607283.776op/s 2627691.305op/s ± 2757.502op/s 2628037.562op/s ± 1413.456op/s 2629446.508op/s 2630738.496op/s 2631576.147op/s 2632390.049op/s 0.17% -3.179 19.387 0.10% 194.985op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.136µs 189.509µs ± 0.192µs 189.494µs ± 0.139µs 189.635µs 189.864µs 190.000µs 190.093µs 0.32% 0.464 -0.166 0.10% 0.014µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5260593.622op/s 5276785.981op/s ± 5332.681op/s 5277212.661op/s ± 3864.549op/s 5281027.688op/s 5284362.094op/s 5285778.746op/s 5287212.213op/s 0.19% -0.459 -0.173 0.10% 377.078op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.843µs 36.951µs ± 0.054µs 36.946µs ± 0.034µs 36.981µs 37.044µs 37.088µs 37.136µs 0.51% 0.557 0.116 0.15% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26927993.450op/s 27063030.605op/s ± 39323.645op/s 27066582.773op/s ± 25176.529op/s 27091026.598op/s 27121644.665op/s 27137951.185op/s 27142317.903op/s 0.28% -0.549 0.102 0.14% 2780.602op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.031µs 45.203µs ± 0.080µs 45.194µs ± 0.052µs 45.249µs 45.353µs 45.386µs 45.430µs 0.52% 0.461 -0.285 0.18% 0.006µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22011946.304op/s 22122599.642op/s ± 39331.160op/s 22126897.009op/s ± 25225.331op/s 22150444.827op/s 22179081.555op/s 22202135.305op/s 22206763.432op/s 0.36% -0.453 -0.292 0.18% 2781.133op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.736µs; 533.843µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1873211.039op/s; 1873584.663op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.507µs; 380.618µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2627309.141op/s; 2628073.468op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.483µs; 189.536µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5276046.922op/s; 5277525.039op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.943µs; 36.958µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27057580.726op/s; 27068480.484op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.192µs; 45.214µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22117148.722op/s; 22128050.563op/s] or [-0.025%; +0.025%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.971µs 35.316µs ± 0.578µs 35.081µs ± 0.040µs 35.123µs 36.372µs 36.406µs 39.757µs 13.33% 3.191 16.351 1.63% 0.041µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.236µs; 35.396µs] or [-0.227%; +0.227%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.187ms 14.243ms ± 0.031ms 14.241ms ± 0.018ms 14.260ms 14.289ms 14.352ms 14.422ms 1.27% 1.495 5.827 0.22% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.239ms; 14.248ms] or [-0.030%; +0.030%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.741µs 25.560µs ± 9.672µs 18.266µs ± 0.459µs 34.046µs 44.157µs 49.856µs 72.354µs 296.12% 1.161 1.561 37.75% 0.684µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.220µs; 26.901µs] or [-5.244%; +5.244%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.962µs 146.400µs ± 1.652µs 146.133µs ± 0.586µs 146.787µs 148.175µs 152.688µs 161.988µs 10.85% 5.317 42.059 1.13% 0.117µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.171µs; 146.629µs] or [-0.156%; +0.156%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.619ms 9.888ms ± 0.085ms 9.901ms ± 0.045ms 9.933ms 10.005ms 10.043ms 10.184ms 2.86% -0.665 1.508 0.86% 0.006ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.876ms; 9.900ms] or [-0.119%; +0.119%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 0a8b343 1765824785 gyuheon0h/prof-13287-document-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 206.100µs 209.417µs ± 3.156µs 206.897µs ± 0.646µs 212.798µs 213.147µs 213.316µs 213.642µs 3.26% 0.176 -1.944 1.50% 0.223µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4680736.454op/s 4776228.398op/s ± 71800.247op/s 4833322.347op/s ± 15148.844op/s 4843205.794op/s 4848162.051op/s 4849742.060op/s 4852004.042op/s 0.39% -0.175 -1.944 1.50% 5077.044op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.555µs 18.695µs ± 0.157µs 18.649µs ± 0.037µs 18.741µs 18.949µs 19.021µs 20.384µs 9.31% 6.596 65.239 0.84% 0.011µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 49057570.527op/s 53494076.070op/s ± 427020.902op/s 53623161.188op/s ± 107315.076op/s 53702044.534op/s 53805234.983op/s 53886907.304op/s 53893109.236op/s 0.50% -6.030 56.739 0.80% 30194.938op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.813µs 10.877µs ± 0.034µs 10.872µs ± 0.018µs 10.892µs 10.944µs 10.969µs 11.023µs 1.39% 1.185 2.547 0.31% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 90720999.872op/s 91940567.829op/s ± 284906.097op/s 91981495.320op/s ± 152247.172op/s 92125320.495op/s 92344706.196op/s 92472080.869op/s 92482797.483op/s 0.55% -1.156 2.447 0.31% 20145.903op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [208.980µs; 209.855µs] or [-0.209%; +0.209%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4766277.575op/s; 4786179.222op/s] or [-0.208%; +0.208%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.673µs; 18.717µs] or [-0.116%; +0.116%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53434895.080op/s; 53553257.060op/s] or [-0.111%; +0.111%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.872µs; 10.881µs] or [-0.043%; +0.043%] None None None
normalization/normalize_name/normalize_name/good throughput [91901082.584op/s; 91980053.074op/s] or [-0.043%; +0.043%] None None None

Baseline

Omitted due to size.

@gyuheon0h gyuheon0h force-pushed the gyuheon0h/prof-13287-document-runtime-stacks branch from 0a8b343 to 59977fb Compare December 15, 2025 20:19
@gyuheon0h gyuheon0h marked this pull request as ready for review December 15, 2025 20:20
@gyuheon0h gyuheon0h requested a review from a team as a code owner December 15, 2025 20:20
@gyuheon0h gyuheon0h requested a review from gleocadie December 15, 2025 20:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gleocadie gleocadie Awaiting requested review from gleocadie

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@gyuheon0h @codecov-commenter