Skip to content

Conversation

@hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Dec 15, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Dec 15, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-12-15 11:36:20

Comparing candidate commit 74c7cb7 in PR branch julio/versioning/live-debugger with baseline commit 73c675b in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.244µs 34.861µs ± 1.013µs 34.402µs ± 0.041µs 34.455µs 36.994µs 37.038µs 38.818µs 12.84% 1.779 1.494 2.90% 0.072µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.720µs; 35.001µs] or [-0.403%; +0.403%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.605ms 10.631ms ± 0.013ms 10.630ms ± 0.008ms 10.637ms 10.655ms 10.673ms 10.686ms 0.53% 1.142 2.498 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.629ms; 10.633ms] or [-0.017%; +0.017%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.912µs 3.915µs 3.917µs 3.919µs 0.22% -1.528 15.196 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255163647.380op/s 255707331.015op/s ± 157855.456op/s 255714910.864op/s ± 80242.585op/s 255800083.138op/s 255893724.920op/s 255964815.088op/s 256893131.654op/s 0.46% 1.555 15.407 0.06% 11162.066op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.122µs 80.621µs ± 0.761µs 80.535µs ± 0.462µs 81.087µs 82.031µs 82.494µs 82.629µs 2.60% 0.488 -0.224 0.94% 0.054µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12102269.644op/s 12404748.610op/s ± 116539.941op/s 12417021.290op/s ± 71023.009op/s 12473895.109op/s 12576840.267op/s 12626760.958op/s 12638659.601op/s 1.78% -0.445 -0.263 0.94% 8240.618op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.493µs 75.080µs ± 0.263µs 75.034µs ± 0.141µs 75.221µs 75.432µs 75.713µs 76.656µs 2.16% 1.991 10.213 0.35% 0.019µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13045322.468op/s 13319373.012op/s ± 46322.055op/s 13327355.273op/s ± 25067.487op/s 13346708.262op/s 13388056.587op/s 13405481.775op/s 13424055.908op/s 0.73% -1.906 9.649 0.35% 3275.464op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.923µs 0.28% -0.281 4.751 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254918699.677op/s 255616784.693op/s ± 209102.058op/s 255632155.242op/s ± 118786.421op/s 255738782.793op/s 255900647.860op/s 255947630.365op/s 256801885.530op/s 0.46% 0.298 4.823 0.08% 14785.748op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.470µs 72.199µs ± 0.254µs 72.178µs ± 0.148µs 72.349µs 72.650µs 72.851µs 73.036µs 1.19% 0.292 0.610 0.35% 0.018µs 1 200
credit_card/is_card_number/378282246310005 throughput 13691868.537op/s 13850871.921op/s ± 48766.603op/s 13854553.628op/s ± 28332.176op/s 13879887.698op/s 13932704.660op/s 13950532.634op/s 13991838.229op/s 0.99% -0.265 0.594 0.35% 3448.320op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.128µs 52.191µs ± 0.027µs 52.189µs ± 0.019µs 52.209µs 52.238µs 52.261µs 52.281µs 0.18% 0.512 0.237 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19127380.985op/s 19160366.271op/s ± 9909.878op/s 19161161.284op/s ± 6864.532op/s 19167617.747op/s 19173776.505op/s 19181654.877op/s 19183586.523op/s 0.12% -0.509 0.233 0.05% 700.734op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.692µs 5.841µs ± 0.066µs 5.830µs ± 0.042µs 5.886µs 5.946µs 6.002µs 6.034µs 3.49% 0.337 0.092 1.12% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165727463.279op/s 171239310.689op/s ± 1921830.411op/s 171515625.633op/s ± 1243330.333op/s 172583351.743op/s 174112792.591op/s 175560810.311op/s 175687800.200op/s 2.43% -0.271 0.033 1.12% 135893.932op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.897µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.912µs 3.915µs 3.916µs 3.917µs 0.16% -1.273 7.125 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255285594.894op/s 255685469.300op/s ± 160265.071op/s 255681936.106op/s ± 84903.370op/s 255768686.682op/s 255901774.716op/s 255983218.257op/s 256578035.696op/s 0.35% 1.287 7.202 0.06% 11332.452op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.065µs 64.500µs ± 0.239µs 64.427µs ± 0.119µs 64.619µs 65.037µs 65.174µs 65.473µs 1.62% 1.317 1.579 0.37% 0.017µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15273448.932op/s 15504121.058op/s ± 57174.946op/s 15521521.368op/s ± 28601.343op/s 15544966.927op/s 15564188.668op/s 15575543.697op/s 15609099.803op/s 0.56% -1.296 1.506 0.37% 4042.879op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.395µs 57.601µs ± 0.163µs 57.558µs ± 0.078µs 57.658µs 57.947µs 58.116µs 58.419µs 1.50% 1.795 4.347 0.28% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17117593.935op/s 17360944.097op/s ± 48824.405op/s 17373868.843op/s ± 23401.824op/s 17394520.726op/s 17412497.390op/s 17420229.996op/s 17423253.074op/s 0.28% -1.769 4.199 0.28% 3452.407op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.892µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.912µs 3.915µs 3.916µs 3.917µs 0.15% -2.357 19.950 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255298772.449op/s 255684663.465op/s ± 158074.116op/s 255682498.550op/s ± 88429.512op/s 255778453.648op/s 255869431.622op/s 255917275.067op/s 256967879.518op/s 0.50% 2.387 20.242 0.06% 11177.528op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.605µs 54.997µs ± 0.268µs 54.941µs ± 0.164µs 55.115µs 55.529µs 55.775µs 56.088µs 2.09% 1.152 1.443 0.49% 0.019µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17829226.962op/s 18183181.420op/s ± 88101.347op/s 18201433.992op/s ± 54342.712op/s 18247330.382op/s 18286903.319op/s 18307683.580op/s 18313372.596op/s 0.61% -1.122 1.333 0.48% 6229.706op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.136µs 52.192µs ± 0.032µs 52.187µs ± 0.016µs 52.206µs 52.253µs 52.281µs 52.293µs 0.20% 0.833 0.731 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19123180.273op/s 19159920.058op/s ± 11688.283op/s 19161873.620op/s ± 5913.114op/s 19167274.276op/s 19177694.903op/s 19179152.454op/s 19180727.205op/s 0.10% -0.830 0.724 0.06% 826.486op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.695µs 5.872µs ± 0.073µs 5.878µs ± 0.049µs 5.921µs 5.993µs 6.033µs 6.041µs 2.77% -0.252 -0.205 1.24% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165535845.068op/s 170321492.808op/s ± 2125460.234op/s 170123322.378op/s ± 1412755.815op/s 171647270.674op/s 174045977.548op/s 175576169.667op/s 175602722.337op/s 3.22% 0.316 -0.170 1.24% 150292.734op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.910µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ throughput [255685453.767op/s; 255729208.263op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.516µs; 80.727µs] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12388597.295op/s; 12420899.925op/s] or [-0.130%; +0.130%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.043µs; 75.116µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13312953.221op/s; 13325792.803op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255587805.159op/s; 255645764.227op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.163µs; 72.234µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number/378282246310005 throughput [13844113.339op/s; 13857630.503op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.187µs; 52.195µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19158992.857op/s; 19161739.684op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.831µs; 5.850µs] or [-0.156%; +0.156%] None None None
credit_card/is_card_number/x371413321323331 throughput [170972963.477op/s; 171505657.900op/s] or [-0.156%; +0.156%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255663258.103op/s; 255707680.498op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.467µs; 64.533µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15496197.161op/s; 15512044.956op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.578µs; 57.624µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17354177.504op/s; 17367710.690op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255662755.913op/s; 255706571.017op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.960µs; 55.034µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18170971.421op/s; 18195391.419op/s] or [-0.067%; +0.067%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.188µs; 52.197µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19158300.174op/s; 19161539.941op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.862µs; 5.882µs] or [-0.172%; +0.172%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [170026924.461op/s; 170616061.154op/s] or [-0.173%; +0.173%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 84.492µs 84.784µs ± 0.304µs 84.738µs ± 0.069µs 84.827µs 85.002µs 85.363µs 88.637µs 4.60% 10.335 127.302 0.36% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [84.742µs; 84.826µs] or [-0.050%; +0.050%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.584ms 9.885ms ± 0.067ms 9.886ms ± 0.034ms 9.927ms 9.990ms 10.052ms 10.065ms 1.81% -0.598 2.335 0.68% 0.005ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.876ms; 9.895ms] or [-0.094%; +0.094%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.445ns 255.999ns ± 14.029ns 249.290ns ± 2.543ns 256.399ns 288.969ns 291.323ns 292.189ns 17.21% 1.530 0.758 5.47% 0.992ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [254.055ns; 257.943ns] or [-0.760%; +0.760%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.841µs 146.785µs ± 1.857µs 146.547µs ± 0.575µs 147.109µs 148.485µs 152.369µs 165.041µs 12.62% 6.171 51.794 1.26% 0.131µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.527µs; 147.042µs] or [-0.175%; +0.175%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.001ms 4.006ms ± 0.007ms 4.005ms ± 0.001ms 4.006ms 4.009ms 4.016ms 4.102ms 2.43% 12.130 159.732 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.005ms; 4.007ms] or [-0.025%; +0.025%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.006µs 533.978µs ± 1.221µs 533.801µs ± 0.227µs 534.066µs 534.502µs 537.930µs 546.186µs 2.32% 8.016 71.324 0.23% 0.086µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1830878.126op/s 1872745.246op/s ± 4205.748op/s 1873356.371op/s ± 795.748op/s 1874085.694op/s 1874949.132op/s 1875807.678op/s 1876151.074op/s 0.15% -7.954 70.453 0.22% 297.391op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 381.376µs 381.912µs ± 0.267µs 381.894µs ± 0.179µs 382.065µs 382.385µs 382.585µs 382.614µs 0.19% 0.423 -0.257 0.07% 0.019µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2613601.615op/s 2618404.527op/s ± 1829.299op/s 2618524.375op/s ± 1227.514op/s 2619793.623op/s 2621085.937op/s 2621702.807op/s 2622081.851op/s 0.14% -0.420 -0.260 0.07% 129.351op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 188.489µs 188.944µs ± 0.213µs 188.920µs ± 0.129µs 189.067µs 189.332µs 189.515µs 189.855µs 0.49% 0.845 1.448 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5267181.851op/s 5292581.799op/s ± 5963.924op/s 5293237.558op/s ± 3607.165op/s 5296421.351op/s 5300808.695op/s 5303808.762op/s 5305358.766op/s 0.23% -0.836 1.420 0.11% 421.713op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.827µs 36.908µs ± 0.043µs 36.901µs ± 0.028µs 36.932µs 36.985µs 37.006µs 37.090µs 0.51% 0.715 0.671 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26961132.393op/s 27094068.849op/s ± 31706.387op/s 27099376.486op/s ± 20404.469op/s 27117078.182op/s 27136468.375op/s 27149899.436op/s 27153990.279op/s 0.20% -0.708 0.647 0.12% 2241.980op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.931µs 45.179µs ± 0.172µs 45.173µs ± 0.117µs 45.286µs 45.381µs 45.451µs 46.654µs 3.28% 3.086 25.175 0.38% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21434399.544op/s 22134535.208op/s ± 83246.365op/s 22137092.903op/s ± 57393.776op/s 22198426.059op/s 22241730.971op/s 22255528.637op/s 22256227.540op/s 0.54% -2.892 23.061 0.38% 5886.407op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.809µs; 534.147µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1872162.370op/s; 1873328.122op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.875µs; 381.949µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2618151.003op/s; 2618658.050op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [188.914µs; 188.973µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5291755.256op/s; 5293408.341op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.903µs; 36.914µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27089674.649op/s; 27098463.050op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.155µs; 45.203µs] or [-0.053%; +0.053%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22122998.063op/s; 22146072.354op/s] or [-0.052%; +0.052%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.400µs 2.438µs ± 0.023µs 2.434µs ± 0.011µs 2.443µs 2.506µs 2.512µs 2.514µs 3.26% 1.901 3.743 0.94% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.435µs; 2.441µs] or [-0.131%; +0.131%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 537.328µs 538.062µs ± 0.531µs 537.962µs ± 0.225µs 538.194µs 538.905µs 540.227µs 541.221µs 0.61% 2.587 9.523 0.10% 0.038µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [537.988µs; 538.136µs] or [-0.014%; +0.014%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.041µs 5.120µs ± 0.059µs 5.130µs ± 0.062µs 5.161µs 5.208µs 5.211µs 5.215µs 1.67% 0.070 -1.409 1.15% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.112µs; 5.129µs] or [-0.159%; +0.159%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.613µs 161.624µs ± 0.338µs 161.571µs ± 0.136µs 161.724µs 162.115µs 162.415µs 164.377µs 1.74% 3.018 21.682 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.577µs; 161.671µs] or [-0.029%; +0.029%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.361ms 62.212ms ± 2.521ms 61.926ms ± 0.086ms 62.001ms 62.157ms 81.612ms 84.162ms 35.91% 7.959 61.920 4.04% 0.178ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.862ms; 62.561ms] or [-0.562%; +0.562%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 187.534ns 190.220ns ± 2.070ns 190.008ns ± 1.521ns 191.360ns 193.764ns 196.893ns 199.027ns 4.75% 1.211 2.127 1.09% 0.146ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [189.933ns; 190.507ns] or [-0.151%; +0.151%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 206.061µs 206.769µs ± 0.497µs 206.640µs ± 0.319µs 207.025µs 207.741µs 208.268µs 208.448µs 0.87% 0.977 0.535 0.24% 0.035µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4797361.399op/s 4836341.281op/s ± 11605.027op/s 4839330.313op/s ± 7459.979op/s 4845498.181op/s 4850219.170op/s 4851312.059op/s 4852923.624op/s 0.28% -0.966 0.501 0.24% 820.599op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.569µs 18.663µs ± 0.056µs 18.656µs ± 0.036µs 18.694µs 18.764µs 18.807µs 18.926µs 1.45% 1.041 2.301 0.30% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52836112.677op/s 53582722.981op/s ± 159853.387op/s 53602119.248op/s ± 103781.324op/s 53698739.604op/s 53798755.642op/s 53854057.895op/s 53854474.257op/s 0.47% -1.012 2.179 0.30% 11303.341op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.750µs 10.821µs ± 0.029µs 10.820µs ± 0.019µs 10.840µs 10.867µs 10.888µs 10.922µs 0.94% 0.235 0.412 0.26% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 91558322.652op/s 92412784.827op/s ± 243898.077op/s 92418670.689op/s ± 158341.321op/s 92569839.566op/s 92823657.761op/s 92952216.201op/s 93019292.627op/s 0.65% -0.216 0.389 0.26% 17246.198op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.700µs; 206.838µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4834732.936op/s; 4837949.626op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.655µs; 18.671µs] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53560568.839op/s; 53604877.123op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.817µs; 10.825µs] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/good throughput [92378982.899op/s; 92446586.755op/s] or [-0.037%; +0.037%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.175ms 14.237ms ± 0.033ms 14.235ms ± 0.019ms 14.252ms 14.298ms 14.348ms 14.402ms 1.18% 1.388 3.805 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.233ms; 14.242ms] or [-0.032%; +0.032%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.067µs 25.817µs ± 9.857µs 18.242µs ± 0.132µs 34.781µs 44.146µs 45.058µs 73.149µs 300.98% 1.037 1.086 38.08% 0.697µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.451µs; 27.183µs] or [-5.291%; +5.291%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 74c7cb7 1765797675 julio/versioning/live-debugger
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.134µs 3.154µs ± 1.439µs 2.982µs ± 0.023µs 2.998µs 3.306µs 13.817µs 15.206µs 409.88% 7.529 57.224 45.50% 0.102µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.955µs; 3.353µs] or [-6.321%; +6.321%] None None None

Baseline

Omitted due to size.

@hoolioh hoolioh force-pushed the julio/versioning/live-debugger branch from 0702943 to 41e7d26 Compare December 15, 2025 11:17
@hoolioh hoolioh force-pushed the julio/versioning/live-debugger branch from 41e7d26 to 74c7cb7 Compare December 15, 2025 11:21
@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 0% with 42 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.16%. Comparing base (73c675b) to head (74c7cb7).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1407      +/-   ##
==========================================
- Coverage   71.16%   71.16%   -0.01%     
==========================================
  Files         403      403              
  Lines       64368    64407      +39     
==========================================
+ Hits        45810    45835      +25     
- Misses      18558    18572      +14     
Components Coverage Δ
libdd-crashtracker 58.99% <ø> (+0.01%) ⬆️
libdd-crashtracker-ffi 16.74% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.81% <ø> (ø)
libdd-data-pipeline-ffi 76.59% <ø> (ø)
libdd-common 81.13% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.95% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 80.44% <ø> (ø)
libdd-profiling-ffi 63.41% <ø> (ø)
datadog-sidecar 36.26% <0.00%> (+0.39%) ⬆️
datdog-sidecar-ffi 12.79% <ø> (+1.99%) ⬆️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.97% <ø> (ø)
datadog-tracer-flare 59.74% <ø> (-3.76%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 15, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.48 MB 86.48 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.49 MB 58.49 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.45 MB 8.45 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.27 MB 100.27 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.61 MB 9.61 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.72 MB 19.72 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 140.15 MB 140.15 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 744.89 MB 744.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.37 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.75 MB 19.75 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.79 MB 38.79 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.83 MB 16.83 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.76 MB 142.76 MB -0% (-8.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 733.41 MB 733.41 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.89 MB 4.89 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.98 MB 20.98 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.54 MB 36.54 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.80 MB 74.80 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.88 MB 8.88 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.83 MB 59.83 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.50 MB 9.50 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.46 MB 94.46 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.32 MB 10.32 MB 0% (0 B) 👌

@hoolioh hoolioh added the keep-open Overrides actions/stale auto-closing stale PRs label Dec 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-build keep-open Overrides actions/stale auto-closing stale PRs sidecar

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants