Skip to content

Fix OpenTelemetry API singleton in server bundles#95743

Closed
bryan-hunter wants to merge 2 commits into
vercel:canaryfrom
bryan-hunter:codex/externalize-opentelemetry-api
Closed

Fix OpenTelemetry API singleton in server bundles#95743
bryan-hunter wants to merge 2 commits into
vercel:canaryfrom
bryan-hunter:codex/externalize-opentelemetry-api

Conversation

@bryan-hunter

@bryan-hunter bryan-hunter commented Jul 13, 2026

Copy link
Copy Markdown

Summary

  • Externalize @opentelemetry/api from server bundles so route code and instrumentation use the same process-wide singleton.
  • Add production direct-entrypoint coverage for a tracer acquired at module scope before instrumentation registration.
  • Sync the documented default serverExternalPackages list.

Problem

A production route can acquire its tracer when the route module is evaluated:

// route.ts — evaluated first
import { trace } from '@opentelemetry/api'

const tracer = trace.getTracer('route')

Instrumentation registers the provider later:

// instrumentation.ts
import { trace } from '@opentelemetry/api'

trace.setGlobalTracerProvider(provider)

This ordering is supported by OpenTelemetry's proxy API. It broke when the route bundle contained API copy A while instrumentation loaded API copy B: registering the provider on B never activated the tracer from A, so custom spans stayed no-op.

Externalizing @opentelemetry/api makes both imports resolve to the same singleton, allowing an early tracer to delegate to the provider after registration.

Reproduction

The E2E fixture reproduces the production sequence: preload the generated route, acquire its module-scope tracer, register OpenTelemetry, then invoke the route.

pnpm test-start-turbo test/e2e/opentelemetry/instrumentation/opentelemetry.test.ts \
  -t "records spans from a tracer acquired before instrumentation registration"
  • Without the new external-package entry: the route and loader receive different API objects, the request returns 500, and no custom span is exported.
  • With the entry: the API objects match, the request returns 200, and the collector receives module-scope-tracer.

Observed versions

Next.js Production observation
16.1.6 Known good: 223 sampled application turn spans alongside 3,979 AI SDK spans
16.2.10 Affected: 0 application turn spans while 342 AI SDK spans confirmed traffic and OTel ingestion continued

These sampled counts establish presence versus absence, not exact traffic volume. The application upgrade also changed its instrumentation integration, so the production comparison identifies the observed boundary but does not isolate Next.js by itself; the E2E negative control above isolates the server bundling behavior.

Target: canary, with a backport to the maintained 16.2.x line.

Testing

  • Production Turbopack direct-entrypoint OpenTelemetry tests: 9 passed
  • pnpm --filter=next types
  • pnpm validate-externals-doc

@github-actions

github-actions Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

Stats from current PR

🟢 1 improvement

Metric Canary PR Change
Webpack Build Time 25.470s 24.851s 🟢 619ms (-2%)
📊 All Metrics
📖 Metrics Glossary

Dev Server Metrics:

  • Listen = TCP port starts accepting connections
  • First Request = HTTP server returns successful response
  • Cold = Fresh build (no cache)
  • Warm = With cached build artifacts

Build Metrics:

  • Fresh = Clean build (no .next directory)
  • Cached = With existing .next directory

Change Thresholds:

  • Time: Changes < 50ms AND < 10%, OR < 2% are insignificant
  • Size: Changes < 1KB AND < 1% are insignificant
  • All other changes are flagged to catch regressions

⚡ Dev Server

Metric Canary PR Change
Cold (Listen) 761ms 762ms
Cold (Ready in log) 763ms 767ms
Cold (First Request) 1.294s 1.280s
Warm (Listen) 808ms 811ms
Warm (Ready in log) 766ms 775ms
Warm (First Request) 1.255s 1.255s
📦 Dev Server (Webpack) (Legacy)

📦 Dev Server (Webpack)

Metric Canary PR Change
Cold (Listen) 814ms 813ms
Cold (Ready in log) 787ms 791ms
Cold (First Request) 3.468s 3.423s
Warm (Listen) 812ms 813ms
Warm (Ready in log) 776ms 792ms
Warm (First Request) 3.449s 3.552s

⚡ Production Builds

Metric Canary PR Change
Fresh Build 4.932s 4.940s
Cached Build 4.925s 4.957s
📦 Production Builds (Webpack) (Legacy)

📦 Production Builds (Webpack)

Metric Canary PR Change
Fresh Build 25.470s 24.851s 🟢 619ms (-2%)
Cached Build 25.525s 25.752s
node_modules Size 516 MB 516 MB
📦 Bundle Sizes

Bundle Sizes

⚡ Turbopack

Client

Main Bundles
Canary PR Change
03gmyxr7dukvs.js gzip 10.3 kB N/A -
03kxtldm3sk2x.js gzip 153 B N/A -
040t1q17lo593.js gzip 8.77 kB N/A -
0bb0vtp8dwsez.js gzip 450 B N/A -
0cz1d0mv5g_q7.js gzip 39.4 kB 39.4 kB
0d9_sdfmlgx3x.js gzip 156 B N/A -
0e985y33y--az.js gzip 45.8 kB N/A -
0ghtcd3-0src1.js gzip 157 B N/A -
0gvibj29i-u0w.js gzip 157 B N/A -
0l0sr6gau5xjn.js gzip 3.53 kB N/A -
0nxqz3q165m2l.js gzip 220 B N/A -
0qr-1tnb7_hg5.js gzip 5.72 kB N/A -
0uilzvklme4ea.js gzip 8.76 kB N/A -
0z0y83mfx-l-h.js gzip 10 kB N/A -
15ok8ydf274z0.js gzip 10.6 kB N/A -
16cqqcigykfea.js gzip 13.6 kB N/A -
17h18zxt1915l.js gzip 1.46 kB N/A -
1elt1qium-r2m.css gzip 115 B 115 B
1fq1h7dxad4cv.js gzip 9.44 kB N/A -
1fym-adbk_69_.js gzip 13.1 kB N/A -
1g80-jfls9qyr.js gzip 13.2 kB N/A -
1gav7nfh4y8ln.js gzip 8.76 kB N/A -
1ljh0cxv8ewm7.js gzip 156 B N/A -
1w8vqo51u2z7m.js gzip 155 B N/A -
256hcvivlx119.js gzip 155 B N/A -
26xnr0078vuee.js gzip 71.1 kB N/A -
28ligxg2pcqgb.js gzip 153 B N/A -
2jh0hejcskd4k.js gzip 162 B N/A -
2rypqffktcxqh.js gzip 8.69 kB N/A -
2uqsizxtehgqf.js gzip 8.79 kB N/A -
2vzktdqwbijqc.js gzip 8.74 kB N/A -
2ywt5-44-_nz7.js gzip 160 B N/A -
2zkqm4tctb0gx.js gzip 167 B N/A -
36wjeu1dua7he.js gzip 156 B N/A -
38ipdetrk9ucb.js gzip 157 B N/A -
3c244akvx_-be.js gzip 8.74 kB N/A -
3dmlemitx3ef3.js gzip 2.29 kB N/A -
3duqgr_j37bji.js gzip 65.6 kB N/A -
3y193x4n8cq9d.js gzip 7.4 kB N/A -
4237vdj6eyslt.js gzip 8.7 kB N/A -
turbopack-0_..vf3q.js gzip 3.86 kB N/A -
turbopack-0w..ldhz.js gzip 3.85 kB N/A -
turbopack-1e..9rsa.js gzip 3.85 kB N/A -
turbopack-1v..y-5d.js gzip 3.85 kB N/A -
turbopack-1v..hah-.js gzip 3.85 kB N/A -
turbopack-2c..me-e.js gzip 3.85 kB N/A -
turbopack-2f..t0ne.js gzip 3.85 kB N/A -
turbopack-2m..jwnj.js gzip 3.85 kB N/A -
turbopack-2o..gr3q.js gzip 3.83 kB N/A -
turbopack-2r..p_fq.js gzip 3.85 kB N/A -
turbopack-2y..v7d3.js gzip 3.85 kB N/A -
turbopack-3r..j6m5.js gzip 3.85 kB N/A -
turbopack-3w.._6ov.js gzip 3.85 kB N/A -
turbopack-3z..-lp0.js gzip 3.85 kB N/A -
00tc16j5-eos9.js gzip N/A 1.46 kB -
05tax4x1rfda4.js gzip N/A 7.4 kB -
0f3x8hscjb7ap.js gzip N/A 156 B -
0gaw1gmpwuwkn.js gzip N/A 8.8 kB -
0v19i0q8g4rho.js gzip N/A 156 B -
12zyjjmq4oad1.js gzip N/A 5.72 kB -
17v7o0y0g4-7-.js gzip N/A 155 B -
1k9cc4-gpa2cx.js gzip N/A 13.1 kB -
1n59uogejo81s.js gzip N/A 10.3 kB -
1noy5y6bnyiy7.js gzip N/A 154 B -
1npei3hlexdv3.js gzip N/A 9.99 kB -
1ssuiwj_rnpc5.js gzip N/A 8.77 kB -
1uqman5iy_ejn.js gzip N/A 156 B -
2-phc9obd3nyd.js gzip N/A 8.77 kB -
24utq57r3l1cw.js gzip N/A 8.7 kB -
2a3jkn8z7ke-t.js gzip N/A 65.6 kB -
2fhjq6ek3srmr.js gzip N/A 8.69 kB -
2g0t7upz_v-hf.js gzip N/A 10.6 kB -
2ghzkgx1ddgu_.js gzip N/A 157 B -
2ia9qqy99aie9.js gzip N/A 13.6 kB -
2koxg04ry-g8s.js gzip N/A 168 B -
2m-y5z-jn6d95.js gzip N/A 155 B -
2oza28kdqvoay.js gzip N/A 8.74 kB -
2zh8-mmhujy8o.js gzip N/A 2.29 kB -
30h_m0irj-q6p.js gzip N/A 221 B -
319hk3fl01uhk.js gzip N/A 71.1 kB -
37ejbfx1u9lpo.js gzip N/A 8.75 kB -
38c63ct4i1cy7.js gzip N/A 449 B -
38i6xpn0ullxe.js gzip N/A 155 B -
3hd1us4ordyc9.js gzip N/A 13.2 kB -
3jimpal3lvz5e.js gzip N/A 9.44 kB -
3olzqw8v8kq4p.js gzip N/A 160 B -
3otxp6kbeequz.js gzip N/A 156 B -
3su6a4l8jbfth.js gzip N/A 3.53 kB -
3w25ccsfocdnd.js gzip N/A 159 B -
3wb4pe4z4-aim.js gzip N/A 8.77 kB -
40j0uuoh0xxc2.js gzip N/A 155 B -
40k6sbmro-wy8.js gzip N/A 45.8 kB -
turbopack-05..ztdo.js gzip N/A 3.85 kB -
turbopack-05..tsib.js gzip N/A 3.85 kB -
turbopack-12..zapb.js gzip N/A 3.85 kB -
turbopack-19..g7-6.js gzip N/A 3.85 kB -
turbopack-1y..7z80.js gzip N/A 3.83 kB -
turbopack-2i..cubw.js gzip N/A 3.86 kB -
turbopack-2v..f86f.js gzip N/A 3.85 kB -
turbopack-2w..l3g5.js gzip N/A 3.85 kB -
turbopack-2x..mykf.js gzip N/A 3.85 kB -
turbopack-2x..xsyd.js gzip N/A 3.85 kB -
turbopack-3_..obhu.js gzip N/A 3.85 kB -
turbopack-35..p4jp.js gzip N/A 3.85 kB -
turbopack-3f..ggdw.js gzip N/A 3.85 kB -
turbopack-3o..gklp.js gzip N/A 3.85 kB -
Total 449 kB 449 kB ⚠️ +43 B

Server

Middleware
Canary PR Change
middleware-b..fest.js gzip 732 B 726 B
Total 732 B 726 B ✅ -6 B
Build Details
Build Manifests
Canary PR Change
_buildManifest.js gzip 432 B 436 B
Total 432 B 436 B ⚠️ +4 B

📦 Webpack

Client

Main Bundles
Canary PR Change
2486.HASH.js gzip 169 B N/A -
3146-HASH.js gzip 64 kB N/A -
39fcf99b-HASH.js gzip 62.9 kB N/A -
8443-HASH.js gzip 4.68 kB N/A -
9431-HASH.js gzip 5.62 kB N/A -
framework-HASH.js gzip 59.8 kB 59.8 kB
main-app-HASH.js gzip 256 B 253 B 🟢 3 B (-1%)
main-HASH.js gzip 39.7 kB 40.1 kB 🔴 +453 B (+1%)
webpack-HASH.js gzip 1.68 kB 1.68 kB
6105-HASH.js gzip N/A 5.63 kB -
764.HASH.js gzip N/A 169 B -
8898-HASH.js gzip N/A 63.4 kB -
9597-HASH.js gzip N/A 4.65 kB -
e1ccab69-HASH.js gzip N/A 62.9 kB -
Total 239 kB 239 kB ✅ -201 B
Polyfills
Canary PR Change
polyfills-HASH.js gzip 39.4 kB 39.4 kB
Total 39.4 kB 39.4 kB
Pages
Canary PR Change
_app-HASH.js gzip 194 B 194 B
_error-HASH.js gzip 183 B 182 B
css-HASH.js gzip 335 B 335 B
dynamic-HASH.js gzip 1.8 kB 1.8 kB
edge-ssr-HASH.js gzip 255 B 254 B
head-HASH.js gzip 351 B 349 B
hooks-HASH.js gzip 384 B 384 B
image-HASH.js gzip 580 B 580 B
index-HASH.js gzip 259 B 259 B
link-HASH.js gzip 2.49 kB 2.49 kB
routerDirect..HASH.js gzip 319 B 319 B
script-HASH.js gzip 386 B 386 B
withRouter-HASH.js gzip 315 B 313 B
1afbb74e6ecf..834.css gzip 106 B 106 B
Total 7.96 kB 7.95 kB ✅ -7 B

Server

Edge SSR
Canary PR Change
edge-ssr.js gzip 128 kB 128 kB
page.js gzip 283 kB 284 kB
Total 410 kB 412 kB ⚠️ +2.21 kB
Middleware
Canary PR Change
middleware-b..fest.js gzip 616 B 614 B
middleware-r..fest.js gzip 156 B 155 B
middleware.js gzip 44.9 kB 45 kB
edge-runtime..pack.js gzip 842 B 842 B
Total 46.5 kB 46.6 kB ⚠️ +71 B
Build Details
Build Manifests
Canary PR Change
_buildManifest.js gzip 719 B 720 B
Total 719 B 720 B ⚠️ +1 B
Build Cache
Canary PR Change
0.pack gzip 4.79 MB 4.78 MB 🟢 6.25 kB (0%)
index.pack gzip 117 kB 119 kB 🔴 +1.85 kB (+2%)
index.pack.old gzip 118 kB 119 kB
Total 5.02 MB 5.02 MB ✅ -3.87 kB

🔄 Shared (bundler-independent)

Runtimes
Canary PR Change
app-page-exp...dev.js gzip 363 kB 363 kB
app-page-exp..prod.js gzip 201 kB 201 kB
app-page-tur...dev.js gzip 363 kB 363 kB
app-page-tur..prod.js gzip 201 kB 201 kB
app-page-tur...dev.js gzip 359 kB 359 kB
app-page-tur..prod.js gzip 199 kB 199 kB
app-page.run...dev.js gzip 360 kB 360 kB
app-page.run..prod.js gzip 199 kB 199 kB
app-route-ex...dev.js gzip 81.1 kB 81.1 kB
app-route-ex..prod.js gzip 55.2 kB 55.2 kB
app-route-tu...dev.js gzip 81.1 kB 81.1 kB
app-route-tu..prod.js gzip 55.2 kB 55.2 kB
app-route-tu...dev.js gzip 80.7 kB 80.7 kB
app-route-tu..prod.js gzip 55 kB 55 kB
app-route.ru...dev.js gzip 80.7 kB 80.7 kB
app-route.ru..prod.js gzip 54.9 kB 54.9 kB
dist_client_...dev.js gzip 324 B 324 B
dist_client_...dev.js gzip 326 B 326 B
dist_client_...dev.js gzip 318 B 318 B
dist_client_...dev.js gzip 317 B 317 B
pages-api-tu...dev.js gzip 45.2 kB 45.2 kB
pages-api-tu..prod.js gzip 34 kB 34 kB
pages-api.ru...dev.js gzip 45.2 kB 45.2 kB
pages-api.ru..prod.js gzip 33.9 kB 33.9 kB
pages-turbo....dev.js gzip 54.7 kB 54.7 kB
pages-turbo...prod.js gzip 39.6 kB 39.6 kB
pages.runtim...dev.js gzip 54.7 kB 54.7 kB
pages.runtim..prod.js gzip 39.6 kB 39.6 kB
server.runti..prod.js gzip 65.3 kB 65.3 kB
use-cache-pr...dev.js gzip 71.4 kB 71.4 kB
use-cache-pr...dev.js gzip 71.4 kB 71.4 kB
use-cache-pr...dev.js gzip 69.7 kB 69.7 kB
use-cache-pr...dev.js gzip 69.7 kB 69.7 kB
Total 3.48 MB 3.48 MB ⚠️ +3 B
📎 Tarball URL
https://vercel-packages.vercel.app/next/commits/52448b5ff865ccbfa0dac35320ebd083dedcffc8/next

Commit: 52448b5

@github-actions

github-actions Bot commented Jul 13, 2026

Copy link
Copy Markdown
Contributor

Tests Passed

Commit: 52448b5

@vercel vercel Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Additional Suggestion:

Docs listing default serverExternalPackages are missing @opentelemetry/api, so pnpm validate-externals-doc fails CI

Fix on Vercel

@vercel vercel Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Additional Suggestion:

Docs listing default serverExternalPackages are missing @opentelemetry/api, so pnpm validate-externals-doc fails CI

Fix on Vercel

@bryan-hunter bryan-hunter marked this pull request as draft July 13, 2026 19:05
@bryan-hunter bryan-hunter changed the title Externalize OpenTelemetry API in server bundles Fix OpenTelemetry API singleton in server bundles Jul 13, 2026
@bryan-hunter bryan-hunter marked this pull request as ready for review July 13, 2026 20:08
@bryan-hunter

Copy link
Copy Markdown
Author

this seems to solve it, so will close!

#94306

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant