Skip to content

feat(realtime): expose granular server error types and payloads#144

Open
VerioN1 wants to merge 7 commits into
mainfrom
feat/realtime-errors-verbosity
Open

feat(realtime): expose granular server error types and payloads#144
VerioN1 wants to merge 7 commits into
mainfrom
feat/realtime-errors-verbosity

Conversation

@VerioN1
Copy link
Copy Markdown
Contributor

@VerioN1 VerioN1 commented May 20, 2026

Previously, real-time server errors were generic. This change introduces
RealtimeWebSocketErrorType and attaches it, along with the full server
payload, to ServerError objects. New REALTIME_ error codes are
added to DecartSDKError to enable more specific error handling and
debugging for different real-time issues like invalid API keys,
insufficient credits, or moderation violations.


Note

Medium Risk
Touches the realtime WebRTC/LiveKit connection path (track publishing, remote track attachment, and stats extraction) and changes error-code semantics for server-originated failures, which could affect existing integrations’ behavior.

Overview
Adds typed realtime server error handling by introducing RealtimeWebSocketErrorType, storing the full server payload on ServerError, and mapping these to new REALTIME_* DecartSDKError codes (with updated exports and unit tests).

Extends the realtime SDK API to accept LiveKit publishOptions/roomOptions, optionally attach remote video to a provided remoteVideoElement, and expose getVideoStats() for publisher and subscriber flows (including enriching stats with codec/QP/freeze data via RTCStatsReport).

Updates the SDK demo index.html into a benchmarking harness: adds chained publish profiles, file-as-video-source streaming, session/stat polling, prompt cycling, recording/export (CSV + PNG dashboard), and auto-run charts for bitrate/FPS/QP/BPP/RTT/loss metrics.

Reviewed by Cursor Bugbot for commit 9a3d59d. Bugbot is set up for automated code reviews on this repo. Configure here.

Previously, real-time server errors were generic. This change introduces
`RealtimeWebSocketErrorType` and attaches it, along with the full server
payload, to `ServerError` objects. New `REALTIME_` error codes are
added to `DecartSDKError` to enable more specific error handling and
debugging for different real-time issues like invalid API keys,
insufficient credits, or moderation violations.
@pkg-pr-new
Copy link
Copy Markdown

pkg-pr-new Bot commented May 20, 2026

Open in StackBlitz

npm i https://pkg.pr.new/@decartai/sdk@144

commit: aca3c82

data?: RealtimeServerErrorData,
cause?: Error,
): DecartSDKError {
const code = data?.errorType ? REALTIME_SERVER_ERROR_CODES[data.errorType] : ERROR_CODES.WEBRTC_SERVER_ERROR;
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unrecognized error type causes undefined error code

Medium Severity

If the server sends an error_type value not present in REALTIME_SERVER_ERROR_CODES (e.g., a newly added server error type before the SDK is updated), REALTIME_SERVER_ERROR_CODES[data.errorType] evaluates to undefined at runtime. This produces a DecartSDKError with code: undefined, violating the code: string type contract and potentially breaking downstream error-handling logic. The incoming message is only type-asserted (as IncomingRealtimeMessage) without validation, so unrecognized values can flow through unchecked. A fallback to WEBRTC_SERVER_ERROR when the lookup misses would prevent this.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit aca3c82. Configure here.

Comment thread packages/sdk/index.html
for (const [groupKey, fields] of statsAggregates) {
const group = {};
for (const [field, { sum, count }] of fields) {
group[field] = sum;
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stats summary outputs sums instead of averages

Medium Severity

buildStatsSummary assigns sum directly to each field but the UI button says "Print Avg Stats" and the console log says "Stats averages." The count is destructured but never used for division. The aggregateStatObject function carefully accumulates both sum and count specifically to enable averaging, but the final computation group[field] = sum omits the / count division, producing misleading raw totals instead of averages.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 1ea50a6. Configure here.

}
}
return { sender: [], receiver };
},
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Receiver stats logic duplicated across two files

Low Severity

The receiver stats gathering logic (iterating remoteParticipants, filtering by identity prefix, checking instanceof RemoteVideoTrack, calling getReceiverStats()) is identically duplicated between MediaChannel.getVideoStats() and the subscribe client's inline getVideoStats. A bug fix in one location would need to be replicated in the other. This could be extracted into a shared utility.

Additional Locations (1)
Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 1ea50a6. Configure here.

@VerioN1 VerioN1 force-pushed the feat/realtime-errors-verbosity branch from 1ea50a6 to 42ea6a2 Compare May 20, 2026 19:45
Comment thread packages/sdk/index.html
Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 2 potential issues.

There are 5 total unresolved issues (including 3 from previous reviews).

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 48a31d1. Configure here.

pauseCount: inbound?.pauseCount,
totalPausesDuration: inbound?.totalPausesDuration,
keyFramesDecoded: inbound?.keyFramesDecoded,
codecMimeType: mime ? mime.slice(mime.indexOf("/") + 1).toUpperCase() : undefined,
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Subscriber stats missing framesPerSecond field unlike publisher

Medium Severity

The enrichReceiverFromReport function in subscribe-client.ts omits framesPerSecond from both its RawInbound type and the merged result, while the equivalent mergeReceiver in media-channel.ts correctly includes it. This means getVideoStats() on the subscribe client will never populate framesPerSecond in receiver stats, creating an inconsistency with the publisher client's stats API.

Additional Locations (1)
Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 48a31d1. Configure here.

Comment thread packages/sdk/index.html Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant