Skip to content

Conversation

@cataphract
Copy link
Contributor

What does this PR do?

In addition to telemetry logs, allow also the submission of metrics via FFI (for the appsec helper, written in C++).

@pr-commenter
Copy link

pr-commenter bot commented Dec 12, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-12-15 09:39:41

Comparing candidate commit 8310dba in PR branch glopes/sidecar-ffi-tel-metrics with baseline commit 73c675b in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.686ms 62.259ms ± 1.985ms 62.005ms ± 0.073ms 62.084ms 62.248ms 76.320ms 81.283ms 31.09% 8.171 66.551 3.18% 0.140ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.984ms; 62.534ms] or [-0.442%; +0.442%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.159ms 14.229ms ± 0.029ms 14.225ms ± 0.017ms 14.244ms 14.271ms 14.336ms 14.370ms 1.02% 1.437 4.873 0.20% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.225ms; 14.233ms] or [-0.028%; +0.028%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 187.824ns 190.613ns ± 2.183ns 190.285ns ± 1.469ns 191.771ns 195.095ns 198.415ns 199.334ns 4.76% 1.292 1.912 1.14% 0.154ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [190.310ns; 190.915ns] or [-0.159%; +0.159%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.425µs 25.036µs ± 9.614µs 17.912µs ± 0.341µs 33.703µs 42.877µs 43.535µs 70.812µs 295.33% 1.065 1.053 38.30% 0.680µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.704µs; 26.369µs] or [-5.322%; +5.322%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 85.436µs 85.787µs ± 0.212µs 85.767µs ± 0.073µs 85.844µs 85.930µs 86.605µs 87.827µs 2.40% 5.616 46.559 0.25% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [85.758µs; 85.817µs] or [-0.034%; +0.034%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.907µs 146.772µs ± 1.666µs 146.551µs ± 0.589µs 147.100µs 148.500µs 152.765µs 162.976µs 11.21% 5.794 47.794 1.13% 0.118µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.541µs; 147.002µs] or [-0.157%; +0.157%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.347µs 161.835µs ± 0.334µs 161.770µs ± 0.144µs 161.918µs 162.383µs 162.920µs 164.108µs 1.45% 2.729 12.379 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.788µs; 161.881µs] or [-0.029%; +0.029%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 9.611ms 9.907ms ± 0.087ms 9.908ms ± 0.041ms 9.954ms 10.033ms 10.108ms 10.213ms 3.07% -0.543 2.020 0.88% 0.006ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [9.895ms; 9.920ms] or [-0.122%; +0.122%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.174µs 3.161µs ± 1.428µs 2.992µs ± 0.025µs 3.013µs 3.310µs 13.712µs 15.204µs 408.08% 7.510 57.065 45.07% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.963µs; 3.359µs] or [-6.261%; +6.261%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.943ms 3.949ms ± 0.008ms 3.947ms ± 0.002ms 3.949ms 3.954ms 3.978ms 4.032ms 2.13% 6.924 62.241 0.20% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.948ms; 3.950ms] or [-0.028%; +0.028%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 206.014µs 206.543µs ± 0.315µs 206.474µs ± 0.187µs 206.697µs 207.118µs 207.333µs 207.886µs 0.68% 1.206 2.126 0.15% 0.022µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4810318.106op/s 4841609.473op/s ± 7376.638op/s 4843229.885op/s ± 4372.341op/s 4847067.012op/s 4850363.882op/s 4852623.061op/s 4854047.961op/s 0.22% -1.194 2.073 0.15% 521.607op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.556µs 18.622µs ± 0.050µs 18.612µs ± 0.016µs 18.634µs 18.672µs 18.835µs 19.100µs 2.62% 5.605 45.342 0.27% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52355277.589op/s 53699988.416op/s ± 141079.193op/s 53728018.753op/s ± 47660.571op/s 53766803.123op/s 53815650.487op/s 53856590.406op/s 53891441.628op/s 0.30% -5.480 43.648 0.26% 9975.805op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.815µs 10.903µs ± 0.047µs 10.896µs ± 0.031µs 10.934µs 10.988µs 11.009µs 11.053µs 1.43% 0.489 -0.224 0.43% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90476611.451op/s 91720823.404op/s ± 392223.271op/s 91773616.206op/s ± 261280.376op/s 91993881.657op/s 92283386.711op/s 92435995.067op/s 92466193.372op/s 0.75% -0.469 -0.251 0.43% 27734.373op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.500µs; 206.587µs] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4840587.142op/s; 4842631.804op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.615µs; 18.629µs] or [-0.037%; +0.037%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53680436.197op/s; 53719540.635op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.896µs; 10.909µs] or [-0.059%; +0.059%] None None None
normalization/normalize_name/normalize_name/good throughput [91666465.031op/s; 91775181.777op/s] or [-0.059%; +0.059%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.314µs 2.376µs ± 0.019µs 2.377µs ± 0.006µs 2.384µs 2.413µs 2.423µs 2.430µs 2.24% -0.798 3.301 0.80% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.374µs; 2.379µs] or [-0.112%; +0.112%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 245.795ns 259.338ns ± 14.416ns 253.023ns ± 4.998ns 264.999ns 291.400ns 294.810ns 300.977ns 18.95% 1.219 0.171 5.55% 1.019ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [257.340ns; 261.336ns] or [-0.770%; +0.770%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.585ms 10.612ms ± 0.014ms 10.610ms ± 0.008ms 10.618ms 10.635ms 10.645ms 10.680ms 0.66% 1.429 4.871 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.610ms; 10.614ms] or [-0.018%; +0.018%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.990µs 5.090µs ± 0.056µs 5.102µs ± 0.049µs 5.147µs 5.167µs 5.172µs 5.174µs 1.41% -0.102 -1.465 1.10% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.083µs; 5.098µs] or [-0.153%; +0.153%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 521.035µs 521.709µs ± 0.407µs 521.651µs ± 0.154µs 521.821µs 522.198µs 522.869µs 526.007µs 0.84% 6.234 60.973 0.08% 0.029µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [521.653µs; 521.766µs] or [-0.011%; +0.011%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.308µs 34.957µs ± 0.999µs 34.515µs ± 0.067µs 34.613µs 37.071µs 37.104µs 38.783µs 12.36% 1.767 1.428 2.85% 0.071µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.819µs; 35.096µs] or [-0.396%; +0.396%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 532.978µs 533.741µs ± 0.524µs 533.703µs ± 0.244µs 533.941µs 534.322µs 534.725µs 539.272µs 1.04% 5.993 60.356 0.10% 0.037µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1854350.377op/s 1873569.142op/s ± 1828.347op/s 1873702.737op/s ± 856.647op/s 1874568.177op/s 1875551.364op/s 1876119.122op/s 1876248.602op/s 0.14% -5.916 59.273 0.10% 129.284op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.346µs 380.229µs ± 0.339µs 380.229µs ± 0.225µs 380.469µs 380.794µs 380.935µs 381.206µs 0.26% 0.040 -0.233 0.09% 0.024µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2623251.774op/s 2629995.539op/s ± 2347.792op/s 2629997.338op/s ± 1553.909op/s 2631498.934op/s 2633821.372op/s 2635115.481op/s 2636117.956op/s 0.23% -0.035 -0.234 0.09% 166.014op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.475µs 189.772µs ± 0.127µs 189.764µs ± 0.095µs 189.865µs 189.985µs 190.040µs 190.107µs 0.18% 0.173 -0.466 0.07% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5260195.574op/s 5269479.483op/s ± 3528.209op/s 5269707.337op/s ± 2642.408op/s 5272217.428op/s 5274607.994op/s 5276604.363op/s 5277746.841op/s 0.15% -0.170 -0.468 0.07% 249.482op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.853µs 36.958µs ± 0.075µs 36.953µs ± 0.039µs 36.991µs 37.032µs 37.083µs 37.754µs 2.17% 6.075 62.397 0.20% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26487604.266op/s 27058169.784op/s ± 54070.535op/s 27061449.431op/s ± 28200.969op/s 27089750.482op/s 27115100.334op/s 27128155.368op/s 27134647.835op/s 0.27% -5.911 60.096 0.20% 3823.364op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.913µs 45.137µs ± 0.184µs 45.102µs ± 0.138µs 45.280µs 45.397µs 45.455µs 46.434µs 2.95% 1.885 10.511 0.41% 0.013µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21536082.630op/s 22154938.873op/s ± 89469.581op/s 22171812.903op/s ± 67802.902op/s 22230543.581op/s 22261629.980op/s 22263787.449op/s 22265103.162op/s 0.42% -1.779 9.554 0.40% 6326.455op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [533.669µs; 533.814µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1873315.751op/s; 1873822.534op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.182µs; 380.276µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2629670.158op/s; 2630320.921op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.755µs; 189.790µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5268990.507op/s; 5269968.459op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.947µs; 36.968µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27050676.128op/s; 27065663.440op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.112µs; 45.163µs] or [-0.056%; +0.056%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22142539.250op/s; 22167338.496op/s] or [-0.056%; +0.056%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8310dba 1765790519 glopes/sidecar-ffi-tel-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.892µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.918µs 3.919µs 0.17% -1.355 8.926 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 255177850.882op/s 255614928.734op/s ± 197749.598op/s 255612291.145op/s ± 110665.932op/s 255736417.592op/s 255893211.666op/s 255976687.442op/s 256948998.838op/s 0.52% 1.376 9.085 0.08% 13983.008op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 79.131µs 80.968µs ± 0.804µs 80.930µs ± 0.585µs 81.540µs 82.328µs 82.855µs 83.132µs 2.72% 0.272 -0.338 0.99% 0.057µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12029093.977op/s 12351825.243op/s ± 122369.647op/s 12356418.628op/s ± 89753.705op/s 12444089.824op/s 12546333.977op/s 12598670.264op/s 12637310.024op/s 2.27% -0.225 -0.377 0.99% 8652.841op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.521µs 75.064µs ± 0.247µs 75.031µs ± 0.122µs 75.158µs 75.426µs 75.738µs 76.720µs 2.25% 2.559 13.596 0.33% 0.017µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13034338.576op/s 13322194.385op/s ± 43527.450op/s 13327881.508op/s ± 21640.582op/s 13349030.066op/s 13371575.650op/s 13403602.472op/s 13419079.247op/s 0.68% -2.472 12.925 0.33% 3077.855op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.915µs 3.917µs 3.918µs 0.17% -1.751 13.108 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 255251071.785op/s 255682343.393op/s ± 168108.715op/s 255672879.567op/s ± 100634.701op/s 255770874.127op/s 255888195.378op/s 256017007.415op/s 256916336.542op/s 0.49% 1.774 13.306 0.07% 11887.081op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.493µs 72.176µs ± 0.240µs 72.149µs ± 0.124µs 72.274µs 72.603µs 72.851µs 72.955µs 1.12% 0.591 1.045 0.33% 0.017µs 1 200
credit_card/is_card_number/378282246310005 throughput 13707089.168op/s 13855153.022op/s ± 45981.379op/s 13860166.579op/s ± 23720.144op/s 13883191.621op/s 13922640.795op/s 13954504.159op/s 13987386.195op/s 0.92% -0.564 1.017 0.33% 3251.374op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.137µs 52.210µs ± 0.030µs 52.212µs ± 0.019µs 52.229µs 52.259µs 52.282µs 52.285µs 0.14% -0.068 -0.121 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19125809.074op/s 19153471.479op/s ± 11184.238op/s 19152710.999op/s ± 6848.370op/s 19160685.148op/s 19172855.933op/s 19178283.472op/s 19180184.951op/s 0.14% 0.071 -0.121 0.06% 790.845op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.691µs 5.840µs ± 0.068µs 5.842µs ± 0.051µs 5.884µs 5.950µs 5.984µs 6.011µs 2.89% 0.037 -0.544 1.16% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 166361686.504op/s 171252241.499op/s ± 1998107.948op/s 171173265.107op/s ± 1475772.772op/s 172703923.057op/s 174507385.061op/s 175538245.287op/s 175706065.291op/s 2.65% 0.014 -0.559 1.16% 141287.568op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.911µs ± 0.003µs 3.911µs ± 0.002µs 3.913µs 3.916µs 3.920µs 3.921µs 0.24% -0.888 11.591 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255064659.440op/s 255671229.503op/s ± 179598.951op/s 255687726.993op/s ± 101492.288op/s 255790082.873op/s 255865688.391op/s 255909636.640op/s 256923779.346op/s 0.48% 0.915 11.764 0.07% 12699.564op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.119µs 64.523µs ± 0.238µs 64.452µs ± 0.135µs 64.652µs 64.977µs 65.158µs 65.481µs 1.60% 1.083 1.032 0.37% 0.017µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15271629.578op/s 15498453.499op/s ± 57055.308op/s 15515514.741op/s ± 32379.716op/s 15541605.266op/s 15563692.159op/s 15577466.630op/s 15595966.662op/s 0.52% -1.063 0.957 0.37% 4034.420op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.387µs 57.580µs ± 0.156µs 57.541µs ± 0.067µs 57.624µs 57.892µs 58.198µs 58.240µs 1.21% 1.898 4.061 0.27% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17170468.610op/s 17367412.793op/s ± 46799.551op/s 17378790.925op/s ± 20186.846op/s 17397045.982op/s 17415839.881op/s 17420755.857op/s 17425647.067op/s 0.27% -1.879 3.968 0.27% 3309.228op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.888µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.918µs 3.920µs 0.22% -2.557 22.825 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255069519.163op/s 255651644.646op/s ± 184794.975op/s 255641739.254op/s ± 84229.720op/s 255729690.217op/s 255909231.426op/s 255988215.096op/s 257189720.015op/s 0.61% 2.596 23.193 0.07% 13066.978op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.611µs 55.009µs ± 0.267µs 54.953µs ± 0.190µs 55.173µs 55.527µs 55.756µs 55.831µs 1.60% 0.823 0.057 0.48% 0.019µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17911332.018op/s 18179167.300op/s ± 87990.331op/s 18197254.059op/s ± 62958.036op/s 18253239.683op/s 18281954.438op/s 18297206.876op/s 18311384.490op/s 0.63% -0.803 0.008 0.48% 6221.856op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.126µs 52.192µs ± 0.037µs 52.187µs ± 0.023µs 52.215µs 52.262µs 52.288µs 52.302µs 0.22% 0.601 0.003 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19119750.583op/s 19160038.112op/s ± 13485.451op/s 19161924.298op/s ± 8293.204op/s 19168605.179op/s 19179344.709op/s 19183111.438op/s 19184343.657op/s 0.12% -0.597 -0.003 0.07% 953.565op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.701µs 5.843µs ± 0.065µs 5.842µs ± 0.049µs 5.893µs 5.948µs 5.969µs 6.030µs 3.22% 0.075 -0.603 1.12% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165848124.872op/s 171167795.327op/s ± 1912729.731op/s 171188316.808op/s ± 1443594.983op/s 172556029.388op/s 174115427.188op/s 175310651.957op/s 175412691.892op/s 2.47% -0.028 -0.619 1.11% 135250.416op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ throughput [255587522.542op/s; 255642334.927op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.856µs; 81.079µs] or [-0.138%; +0.138%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12334865.986op/s; 12368784.499op/s] or [-0.137%; +0.137%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [75.029µs; 75.098µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13316161.899op/s; 13328226.871op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/37828224631 throughput [255659045.142op/s; 255705641.644op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.143µs; 72.209µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/378282246310005 throughput [13848780.445op/s; 13861525.599op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.206µs; 52.214µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19151921.451op/s; 19155021.507op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.831µs; 5.850µs] or [-0.162%; +0.162%] None None None
credit_card/is_card_number/x371413321323331 throughput [170975322.954op/s; 171529160.044op/s] or [-0.162%; +0.162%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255646338.815op/s; 255696120.190op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.490µs; 64.556µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15490546.182op/s; 15506360.816op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.558µs; 57.601µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17360926.825op/s; 17373898.761op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255626033.840op/s; 255677255.452op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.972µs; 55.046µs] or [-0.067%; +0.067%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18166972.687op/s; 18191361.914op/s] or [-0.067%; +0.067%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.187µs; 52.197µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19158169.159op/s; 19161907.066op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.834µs; 5.852µs] or [-0.155%; +0.155%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [170902709.383op/s; 171432881.272op/s] or [-0.155%; +0.155%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Dec 12, 2025

Codecov Report

❌ Patch coverage is 0% with 173 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.01%. Comparing base (73c675b) to head (8310dba).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1400      +/-   ##
==========================================
- Coverage   71.16%   71.01%   -0.16%     
==========================================
  Files         403      403              
  Lines       64368    64509     +141     
==========================================
- Hits        45810    45809       -1     
- Misses      18558    18700     +142     
Components Coverage Δ
libdd-crashtracker 58.99% <ø> (+0.01%) ⬆️
libdd-crashtracker-ffi 16.74% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.83% <ø> (+0.01%) ⬆️
libdd-data-pipeline-ffi 76.59% <ø> (ø)
libdd-common 81.13% <ø> (ø)
libdd-common-ffi 74.96% <ø> (ø)
libdd-telemetry 59.92% <ø> (-0.04%) ⬇️
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.71% <ø> (+0.10%) ⬆️
libdd-profiling 80.44% <ø> (ø)
libdd-profiling-ffi 63.41% <ø> (ø)
datadog-sidecar 35.04% <0.00%> (-0.82%) ⬇️
datdog-sidecar-ffi 9.75% <0.00%> (-1.04%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.97% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Dec 12, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 86.48 MB 86.48 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.44 MB 7.44 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 58.49 MB 58.49 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 8.45 MB 8.45 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 100.27 MB 100.27 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.61 MB 9.61 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 19.72 MB 19.72 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 140.15 MB 140.14 MB -0% (-8.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 744.89 MB 744.89 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 6.37 MB 6.37 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 69.82 KB 69.82 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 19.75 MB 19.75 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 38.79 MB 38.79 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 16.83 MB 16.83 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 142.76 MB 142.76 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 733.41 MB 733.41 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.89 MB 4.89 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 70.90 KB 70.90 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 20.98 MB 20.98 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 36.54 MB 36.54 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 74.80 MB 74.80 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.88 MB 8.88 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 59.83 MB 59.83 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 9.50 MB 9.50 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 94.46 MB 94.46 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.32 MB 10.32 MB 0% (0 B) 👌

@cataphract cataphract force-pushed the glopes/sidecar-ffi-tel-metrics branch from 259ca4b to 8310dba Compare December 15, 2025 09:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants