Skip to content

Conversation

@hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Dec 17, 2025

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Dec 17, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-12-19 16:54:10

Comparing candidate commit 6d70344 in PR branch julio/versioning/pr-semver-check with baseline commit 5027515 in branch julio/versioning/enforce-conventional-commits-pr.

Found 2 performance improvements and 14 performance regressions! Performance is the same for 41 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+3.448µs; +3.778µs] or [+4.398%; +4.819%]
  • 🟥 throughput [-588220.282op/s; -536617.992op/s] or [-4.611%; -4.207%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+4.106µs; +4.190µs] or [+5.793%; +5.912%]
  • 🟥 throughput [-788267.230op/s; -772203.624op/s] or [-5.586%; -5.473%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+4.397µs; +4.500µs] or [+6.498%; +6.650%]
  • 🟥 throughput [-922321.960op/s; -900956.426op/s] or [-6.241%; -6.097%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+7.093µs; +7.146µs] or [+15.734%; +15.851%]
  • 🟥 throughput [-3038751.483op/s; -3012810.935op/s] or [-13.698%; -13.582%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+4.544µs; +4.577µs] or [+8.572%; +8.635%]
  • 🟥 throughput [-1499443.548op/s; -1489287.305op/s] or [-7.949%; -7.895%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+5.007µs; +5.063µs] or [+10.053%; +10.164%]
  • 🟥 throughput [-1852018.038op/s; -1833676.097op/s] or [-9.225%; -9.134%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+7.038µs; +7.088µs] or [+15.596%; +15.706%]
  • 🟥 throughput [-3011179.896op/s; -2986862.739op/s] or [-13.589%; -13.479%]

scenario:profile_add_sample2_frames_x1000

  • 🟩 execution_time [-25.220µs; -25.073µs] or [-4.598%; -4.571%]

scenario:sql/obfuscate_sql_string

  • 🟩 execution_time [-3.814µs; -3.729µs] or [-4.258%; -4.163%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.130ns 190.972ns ± 2.433ns 190.459ns ± 1.493ns 192.167ns 195.909ns 198.104ns 201.576ns 5.84% 1.314 1.745 1.27% 0.172ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.635ns; 191.309ns] or [-0.177%; +0.177%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.203µs 34.774µs ± 0.936µs 34.336µs ± 0.075µs 34.484µs 36.777µs 36.826µs 37.596µs 9.49% 1.685 0.953 2.68% 0.066µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.644µs; 34.903µs] or [-0.373%; +0.373%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.912µs 3.914µs 3.916µs 3.917µs 0.15% -2.266 20.056 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 255307337.315op/s 255690489.898op/s ± 142737.740op/s 255690079.226op/s ± 72566.997op/s 255764279.958op/s 255867611.197op/s 255936107.714op/s 256845040.877op/s 0.45% 2.295 20.315 0.06% 10093.082op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.923µs 82.017µs ± 0.791µs 82.041µs ± 0.587µs 82.618µs 83.226µs 83.453µs 83.828µs 2.18% -0.186 -0.507 0.96% 0.056µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11929189.504op/s 12193668.518op/s ± 117786.493op/s 12188977.520op/s ± 87181.610op/s 12277508.392op/s 12382252.757op/s 12472533.556op/s 12512042.841op/s 2.65% 0.228 -0.470 0.96% 8328.763op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.594µs 75.018µs ± 0.188µs 74.991µs ± 0.103µs 75.116µs 75.299µs 75.615µs 75.999µs 1.34% 1.178 4.468 0.25% 0.013µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13158074.330op/s 13330272.882op/s ± 33316.769op/s 13334897.035op/s ± 18347.192op/s 13349479.564op/s 13374183.881op/s 13402933.398op/s 13405826.172op/s 0.53% -1.141 4.303 0.25% 2355.851op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.913µs 3.915µs 3.917µs 3.921µs 0.25% -0.999 12.181 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255066287.808op/s 255684580.830op/s ± 162073.841op/s 255697289.632op/s ± 87630.962op/s 255780091.143op/s 255858725.803op/s 255895819.183op/s 256830207.009op/s 0.44% 1.024 12.345 0.06% 11460.351op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.181µs 72.119µs ± 0.230µs 72.118µs ± 0.155µs 72.281µs 72.501µs 72.646µs 72.706µs 0.81% -0.106 0.792 0.32% 0.016µs 1 200
credit_card/is_card_number/378282246310005 throughput 13754035.300op/s 13866121.885op/s ± 44247.378op/s 13866118.143op/s ± 29943.019op/s 13895848.615op/s 13935022.265op/s 13957937.659op/s 14048729.687op/s 1.32% 0.133 0.839 0.32% 3128.762op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.131µs 52.199µs ± 0.036µs 52.196µs ± 0.020µs 52.215µs 52.267µs 52.323µs 52.332µs 0.26% 1.149 2.208 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19108711.950op/s 19157374.548op/s ± 13121.023op/s 19158497.905op/s ± 7377.315op/s 19166167.882op/s 19173484.320op/s 19180117.104op/s 19182593.714op/s 0.13% -1.143 2.189 0.07% 927.796op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.704µs 5.875µs ± 0.067µs 5.883µs ± 0.046µs 5.918µs 5.974µs 6.031µs 6.035µs 2.58% -0.046 -0.238 1.14% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165697608.748op/s 170239661.055op/s ± 1949270.875op/s 169977660.689op/s ± 1344228.861op/s 171591152.069op/s 173520341.091op/s 174614684.703op/s 175307385.447op/s 3.14% 0.106 -0.235 1.14% 137834.265op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.922µs 0.24% -0.930 8.225 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254984767.727op/s 255591177.886op/s ± 209409.116op/s 255595768.046op/s ± 122157.781op/s 255722420.480op/s 255847037.854op/s 255929202.524op/s 256965607.008op/s 0.54% 0.953 8.377 0.08% 14807.461op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.197µs 64.380µs ± 0.159µs 64.348µs ± 0.070µs 64.423µs 64.688µs 64.956µs 65.409µs 1.65% 2.722 11.202 0.25% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15288520.849op/s 15532975.493op/s ± 38009.133op/s 15540538.792op/s ± 16907.702op/s 15556300.020op/s 15569872.310op/s 15575554.199op/s 15577168.544op/s 0.24% -2.680 10.858 0.24% 2687.652op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.367µs 57.570µs ± 0.116µs 57.542µs ± 0.061µs 57.627µs 57.791µs 57.916µs 57.987µs 0.77% 1.005 0.964 0.20% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17245244.624op/s 17370080.033op/s ± 34988.898op/s 17378751.005op/s ± 18495.884op/s 17393224.904op/s 17416093.343op/s 17427269.774op/s 17431495.226op/s 0.30% -0.994 0.933 0.20% 2474.089op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.917µs 3.918µs 0.15% -1.547 13.376 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255248414.505op/s 255641538.047op/s ± 144972.970op/s 255643298.319op/s ± 82848.334op/s 255732772.156op/s 255814489.785op/s 255870936.897op/s 256707989.592op/s 0.42% 1.569 13.553 0.06% 10251.137op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.585µs 54.846µs ± 0.196µs 54.812µs ± 0.094µs 54.907µs 55.182µs 55.680µs 55.865µs 1.92% 2.287 7.571 0.36% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17900241.076op/s 18233243.585op/s ± 64685.317op/s 18244210.120op/s ± 31424.804op/s 18275633.098op/s 18297379.551op/s 18309786.093op/s 18320007.280op/s 0.42% -2.241 7.289 0.35% 4573.943op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.144µs 52.193µs ± 0.032µs 52.185µs ± 0.015µs 52.206µs 52.254µs 52.292µs 52.360µs 0.33% 1.630 4.446 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19098634.000op/s 19159812.785op/s ± 11566.222op/s 19162569.753op/s ± 5382.790op/s 19166771.048op/s 19174023.895op/s 19177075.341op/s 19177640.789op/s 0.08% -1.624 4.408 0.06% 817.855op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.695µs 5.841µs ± 0.069µs 5.833µs ± 0.045µs 5.892µs 5.967µs 6.005µs 6.034µs 3.44% 0.394 -0.104 1.18% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165733636.924op/s 171220448.830op/s ± 2022279.947op/s 171439063.446op/s ± 1331090.662op/s 172630367.319op/s 174436438.693op/s 175532243.711op/s 175603479.348op/s 2.43% -0.332 -0.163 1.18% 142996.786op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.911µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255670707.820op/s; 255710271.976op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [81.908µs; 82.127µs] or [-0.134%; +0.134%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12177344.442op/s; 12209992.593op/s] or [-0.134%; +0.134%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [74.992µs; 75.044µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13325655.498op/s; 13334890.265op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255662118.954op/s; 255707042.706op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.087µs; 72.151µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/378282246310005 throughput [13859989.624op/s; 13872254.146op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.194µs; 52.204µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19155556.100op/s; 19159192.995op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.866µs; 5.884µs] or [-0.159%; +0.159%] None None None
credit_card/is_card_number/x371413321323331 throughput [169969510.859op/s; 170509811.251op/s] or [-0.159%; +0.159%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255562155.797op/s; 255620199.976op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.358µs; 64.402µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15527707.793op/s; 15538243.194op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.554µs; 57.587µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17365230.909op/s; 17374929.158op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255621446.188op/s; 255661629.906op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.818µs; 54.873µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18224278.822op/s; 18242208.348op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.188µs; 52.197µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19158209.818op/s; 19161415.752op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.832µs; 5.851µs] or [-0.164%; +0.164%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [170940180.279op/s; 171500717.381op/s] or [-0.164%; +0.164%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.177µs 26.620µs ± 9.472µs 18.822µs ± 0.326µs 34.625µs 43.011µs 43.990µs 62.005µs 229.42% 0.791 0.001 35.49% 0.670µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.307µs; 27.932µs] or [-4.931%; +4.931%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.993ms 3.997ms ± 0.006ms 3.996ms ± 0.001ms 3.998ms 3.999ms 4.002ms 4.077ms 2.02% 11.804 153.233 0.15% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.996ms; 3.998ms] or [-0.021%; +0.021%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.607ms 10.639ms ± 0.015ms 10.637ms ± 0.010ms 10.649ms 10.661ms 10.678ms 10.718ms 0.76% 0.979 3.004 0.15% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.636ms; 10.641ms] or [-0.020%; +0.020%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.760µs 162.466µs ± 0.385µs 162.394µs ± 0.125µs 162.518µs 163.064µs 164.363µs 164.895µs 1.54% 3.258 14.568 0.24% 0.027µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.413µs; 162.520µs] or [-0.033%; +0.033%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.171ms 14.247ms ± 0.035ms 14.242ms ± 0.018ms 14.260ms 14.314ms 14.361ms 14.445ms 1.42% 1.555 5.620 0.25% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.242ms; 14.252ms] or [-0.034%; +0.034%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.042ns 257.652ns ± 14.346ns 250.940ns ± 3.977ns 262.698ns 290.760ns 294.040ns 294.949ns 17.54% 1.386 0.504 5.55% 1.014ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.664ns; 259.640ns] or [-0.772%; +0.772%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 145.348µs 147.340µs ± 1.792µs 146.964µs ± 0.564µs 147.683µs 149.348µs 154.044µs 165.077µs 12.32% 5.872 49.738 1.21% 0.127µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [147.092µs; 147.589µs] or [-0.169%; +0.169%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 206.150µs 206.722µs ± 0.432µs 206.603µs ± 0.224µs 206.907µs 207.638µs 207.954µs 208.336µs 0.84% 1.276 1.282 0.21% 0.031µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4799945.410op/s 4837443.347op/s ± 10088.687op/s 4840208.371op/s ± 5244.915op/s 4844896.054op/s 4848352.097op/s 4849850.185op/s 4850846.945op/s 0.22% -1.265 1.245 0.21% 713.378op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.563µs 18.644µs ± 0.061µs 18.633µs ± 0.025µs 18.656µs 18.771µs 18.863µs 18.971µs 1.81% 2.204 6.708 0.33% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52713235.087op/s 53638115.139op/s ± 173795.795op/s 53667368.770op/s ± 73285.004op/s 53745876.998op/s 53827440.040op/s 53853110.917op/s 53870799.561op/s 0.38% -2.167 6.483 0.32% 12289.219op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.818µs 10.890µs ± 0.053µs 10.884µs ± 0.022µs 10.908µs 10.948µs 10.983µs 11.435µs 5.06% 5.523 53.514 0.49% 0.004µs 1 200
normalization/normalize_name/normalize_name/good throughput 87449407.847op/s 91826148.234op/s ± 436816.463op/s 91873990.971op/s ± 189660.556op/s 92045559.771op/s 92365634.797op/s 92414856.007op/s 92438397.923op/s 0.61% -5.170 48.752 0.47% 30887.588op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.662µs; 206.782µs] or [-0.029%; +0.029%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4836045.152op/s; 4838841.542op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.635µs; 18.652µs] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53614028.713op/s; 53662201.564op/s] or [-0.045%; +0.045%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.883µs; 10.898µs] or [-0.068%; +0.068%] None None None
normalization/normalize_name/normalize_name/good throughput [91765609.674op/s; 91886686.795op/s] or [-0.066%; +0.066%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.524µs 85.810µs ± 0.232µs 85.786µs ± 0.048µs 85.840µs 85.949µs 86.098µs 88.823µs 3.54% 11.111 141.818 0.27% 0.016µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.778µs; 85.842µs] or [-0.037%; +0.037%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.088ms 61.563ms ± 1.771ms 61.334ms ± 0.115ms 61.439ms 61.697ms 68.756ms 83.427ms 36.02% 10.249 117.249 2.87% 0.125ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.317ms; 61.808ms] or [-0.399%; +0.399%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.857ms 9.984ms ± 0.048ms 9.983ms ± 0.023ms 10.005ms 10.053ms 10.097ms 10.359ms 3.77% 2.329 17.300 0.48% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.977ms; 9.991ms] or [-0.067%; +0.067%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.268µs 3.232µs ± 1.433µs 3.009µs ± 0.030µs 3.039µs 3.676µs 14.099µs 14.813µs 392.27% 7.307 54.686 44.22% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.034µs; 3.431µs] or [-6.144%; +6.144%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 522.808µs 523.383µs ± 0.314µs 523.314µs ± 0.160µs 523.514µs 524.027µs 524.397µs 524.464µs 0.22% 1.123 1.446 0.06% 0.022µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [523.340µs; 523.427µs] or [-0.008%; +0.008%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.033µs 5.097µs ± 0.042µs 5.092µs ± 0.033µs 5.128µs 5.172µs 5.175µs 5.182µs 1.76% 0.514 -1.079 0.83% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.091µs; 5.103µs] or [-0.115%; +0.115%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.016µs 533.861µs ± 0.362µs 533.861µs ± 0.232µs 534.077µs 534.470µs 534.814µs 535.100µs 0.23% 0.453 0.469 0.07% 0.026µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1868809.363op/s 1873146.536op/s ± 1269.915op/s 1873147.684op/s ± 814.636op/s 1874085.488op/s 1874994.420op/s 1875558.037op/s 1876115.254op/s 0.16% -0.448 0.461 0.07% 89.797op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.550µs 380.307µs ± 0.323µs 380.305µs ± 0.227µs 380.505µs 380.824µs 381.069µs 381.405µs 0.29% 0.324 0.166 0.08% 0.023µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2621886.367op/s 2629454.640op/s ± 2235.351op/s 2629467.401op/s ± 1572.265op/s 2631136.335op/s 2632814.005op/s 2634198.800op/s 2634696.873op/s 0.20% -0.319 0.159 0.08% 158.063op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 188.590µs 188.977µs ± 0.185µs 188.941µs ± 0.118µs 189.088µs 189.337µs 189.428µs 189.485µs 0.29% 0.498 -0.264 0.10% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5277473.737op/s 5291646.352op/s ± 5178.853op/s 5292662.749op/s ± 3317.681op/s 5295487.718op/s 5299158.284op/s 5301661.266op/s 5302520.739op/s 0.19% -0.494 -0.268 0.10% 366.200op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.857µs 36.946µs ± 0.044µs 36.944µs ± 0.026µs 36.969µs 37.022µs 37.081µs 37.121µs 0.48% 0.819 1.475 0.12% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26938937.885op/s 27066666.874op/s ± 32053.154op/s 27068267.430op/s ± 19403.355op/s 27087756.343op/s 27112829.078op/s 27126803.839op/s 27131524.323op/s 0.23% -0.809 1.448 0.12% 2266.500op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.895µs 45.181µs ± 0.168µs 45.171µs ± 0.126µs 45.300µs 45.409µs 45.552µs 46.284µs 2.46% 1.516 7.773 0.37% 0.012µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21605738.484op/s 22133732.987op/s ± 82061.580op/s 22137912.443op/s ± 61462.923op/s 22195561.522op/s 22241556.452op/s 22262372.825op/s 22274052.016op/s 0.61% -1.435 7.137 0.37% 5802.630op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.811µs; 533.911µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1872970.538op/s; 1873322.534op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.262µs; 380.352µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2629144.842op/s; 2629764.438op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [188.952µs; 189.003µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5290928.613op/s; 5292364.091op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.940µs; 36.952µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27062224.615op/s; 27071109.133op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.157µs; 45.204µs] or [-0.052%; +0.052%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22122360.042op/s; 22145105.933op/s] or [-0.051%; +0.051%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 6d70344 1766162281 julio/versioning/pr-semver-check
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.417µs 2.439µs ± 0.018µs 2.437µs ± 0.007µs 2.442µs 2.489µs 2.500µs 2.510µs 3.02% 2.016 4.362 0.74% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.437µs; 2.442µs] or [-0.103%; +0.103%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Dec 17, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.41%. Comparing base (23b0837) to head (6d70344).
⚠️ Report is 1 commits behind head on julio/versioning/enforce-conventional-commits-pr.

Additional details and impacted files
@@                                 Coverage Diff                                  @@
##           julio/versioning/enforce-conventional-commits-pr    #1414      +/-   ##
====================================================================================
- Coverage                                             71.44%   71.41%   -0.03%     
====================================================================================
  Files                                                   406      411       +5     
  Lines                                                 65203    66028     +825     
====================================================================================
+ Hits                                                  46585    47157     +572     
- Misses                                                18618    18871     +253     
Components Coverage Δ
libdd-crashtracker 58.72% <ø> (-0.24%) ⬇️
libdd-crashtracker-ffi 14.72% <ø> (-2.02%) ⬇️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.66% <ø> (-0.96%) ⬇️
libdd-data-pipeline-ffi 75.75% <ø> (-5.33%) ⬇️
libdd-common 81.33% <ø> (+0.12%) ⬆️
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.92% <ø> (-0.04%) ⬇️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (ø)
libdd-profiling 81.72% <ø> (-0.13%) ⬇️
libdd-profiling-ffi 67.83% <ø> (+4.41%) ⬆️
datadog-sidecar 36.17% <ø> (-0.05%) ⬇️
datdog-sidecar-ffi 12.37% <ø> (-0.25%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (+0.28%) ⬆️
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 90.07% <ø> (ø)
datadog-tracer-flare 61.06% <ø> (-2.44%) ⬇️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 17, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.48 MB 86.48 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.49 MB 58.49 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.45 MB 8.45 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.27 MB 100.27 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.61 MB 9.61 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.72 MB 19.72 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 140.15 MB 140.21 MB +.04% (+64.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 744.89 MB 744.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.37 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.75 MB 19.75 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.79 MB 38.79 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.83 MB 16.83 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.76 MB 142.81 MB +.03% (+48.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 733.41 MB 733.41 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.89 MB 4.89 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.98 MB 20.98 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.54 MB 36.54 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.80 MB 74.80 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.88 MB 8.88 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.83 MB 59.83 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.50 MB 9.50 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.46 MB 94.46 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.32 MB 10.32 MB 0% (0 B) 👌

@hoolioh hoolioh changed the title Julio/versioning/pr semver check ci: check that PR title and source code changes are aligned Dec 19, 2025
@hoolioh hoolioh changed the base branch from main to julio/versioning/enforce-conventional-commits-pr December 19, 2025 16:44
echo "No published crates changed in this PR"
else
echo "has_changes=true" >> "$GITHUB_OUTPUT"
CRATES_JSON=$(printf '%s\n' "${CHANGED_CRATES[@]}" | jq -R . | jq -s .)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GITHUB_OUTPUT requires single-line values

Suggested change
CRATES_JSON=$(printf '%s\n' "${CHANGED_CRATES[@]}" | jq -R . | jq -s .)
CRATES_JSON=$(printf '%s\n' "${CHANGED_CRATES[@]}" | jq -R . | jq -s -c .)

persist-credentials: false

- name: Install Rust ${{ env.RUST_VERSION }}
run: rustup install ${{ env.RUST_VERSION }} && rustup default ${{ env.RUST_VERSION }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it seems cargo-public-api requires nightly

Suggested change
run: rustup install ${{ env.RUST_VERSION }} && rustup default ${{ env.RUST_VERSION }}
run: rustup install ${{ env.RUST_VERSION }} && rustup default ${{ env.RUST_VERSION }} && rustup install nightly --profile minimal


- name: Install cargo-semver-checks
run: |
apt install libssl-dev # cargo-public-api dependency
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sudo can be needed

Suggested change
apt install libssl-dev # cargo-public-api dependency
sudo apt update && sudo apt install -y libssl-dev # cargo-public-api dependency


# Try to run cargo-public-api diff
set +e
cargo public-api --package "$CRATE_NAME" diff "$CURRENT_VERSION" 2>&1 | tee api-output.txt
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we diff with the published version of the crate, or with the commit from main branch? I mean, it should be limited just to the changes in the PR, isn't it?

with:
cache-targets: true

- name: Install cargo-semver-checks
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- name: Install cargo-semver-checks
- name: Install cargo-public-api

echo "$HIGHEST_LEVEL" > semver-level.txt
printf '%s\n' "${CRATES_CHECKED[@]}" > crates_checked.txt || true

- name: Aggregate results
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need this step?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The rest of workflow files have .yml extension

REGEX='^([a-z]+)(\([^)]+\))?(!)?: .+'
if [[ "$PR_TITLE" =~ $REGEX ]]; then
TYPE="${BASH_REMATCH[1]}"
HAS_BREAKING_MARKER="${BASH_REMATCH[3]}"
Copy link
Contributor

@iunanua iunanua Dec 24, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it seems conventional commits also allow you to specify breaking changes by including the BREAKING CHANGES token in the footer of the commit

https://www.conventionalcommits.org/en/v1.0.0/#specification

Shall we take it into account?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants