Skip to content

WIP: Add mesh gradient audio visualizer to agents-ui#1359

Draft
thomasyuill-livekit wants to merge 2 commits into
mainfrom
ty/mesh-gradient-audio-visualizer
Draft

WIP: Add mesh gradient audio visualizer to agents-ui#1359
thomasyuill-livekit wants to merge 2 commits into
mainfrom
ty/mesh-gradient-audio-visualizer

Conversation

@thomasyuill-livekit

Copy link
Copy Markdown
Contributor

Overview

Adds AgentAudioVisualizerMeshGradient, a new shader-based audio visualizer for packages/shadcn that renders an animated mesh gradient of blended color blobs, reactive to agent state and live microphone volume — joining the existing Aura/Wave/Grid/Bar/Radial visualizer family.

Summary of changes

Area Change
Component New agent-audio-visualizer-mesh-gradient.tsx — WebGL1/GLSL shader (adapted from paper-design/shaders' mesh-gradient algorithm) rendered via the existing ReactShaderToy wrapper
Props colors, grain, scale, rotation, distortion, swirl, size, state, audioTrack
Hook New use-agent-audio-visualizer-mesh-gradient.ts — maps AgentState to speed/distortion/swirl targets, with live volume driving distortion while speaking
Storybook New story with Default, Sunset, Ocean, Aurora, Monochrome color presets and range controls for all shader params
Registry New agent-audio-visualizer-mesh-gradient entry in registry.json, added to the all bundle
Tests Component + hook unit tests (27 new tests)

Testing

  • cd packages/shadcn && pnpm test — all 301 tests pass
  • pnpm --filter docs-storybook devAgents UI → AgentAudioVisualizerMeshGradient — cycle through the color presets, state values, and the scale/rotation/distortion/swirl/grain controls

Adds AgentAudioVisualizerMeshGradient, a shader-based visualizer that
renders an animated mesh gradient of blended color blobs, reacting to
agent state and live microphone volume. Includes scale, rotation,
distortion, swirl, and grain controls, a Storybook story with several
color presets, registry entries, and tests.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@vercel

vercel Bot commented Jul 7, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
components-js-storybook-5kld Ready Ready Preview, Comment Jul 7, 2026 4:14pm

Request Review

@changeset-bot

changeset-bot Bot commented Jul 7, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 5065f0c

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

size-limit report 📦

Path Size
LiveKitRoom only 6.01 KB (0%)
LiveKitRoom with VideoConference 32.25 KB (0%)
All exports 43.68 KB (0%)

@thomasyuill-livekit thomasyuill-livekit marked this pull request as draft July 7, 2026 16:08
@thomasyuill-livekit thomasyuill-livekit changed the title Add mesh gradient audio visualizer to agents-ui WIP: Add mesh gradient audio visualizer to agents-ui Jul 7, 2026
Rotation now spins continuously while speaking, and scale pulses
while thinking, using the same motion-based animation pattern as
distortion and swirl.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant