██████╗ █████╗ ███╗ ██╗██╗ ██╗██╗███████╗██╗ ██╗
██╔══██╗██╔══██╗████╗ ██║██║ ██╔╝██║██╔════╝╚██╗ ██╔╝
██████╔╝███████║██╔██╗ ██║█████╔╝ ██║█████╗ ╚████╔╝
██╔══██╗██╔══██║██║╚██╗██║██╔═██╗ ██║██╔══╝ ╚██╔╝
██║ ██║██║ ██║██║ ╚████║██║ ██╗██║██║ ██║
╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═══╝╚═╝ ╚═╝╚═╝╚═╝ ╚═╝
█████╗ ███████╗███████╗██╗███████╗████████╗
██╔══██╗██╔════╝██╔════╝██║██╔════╝╚══██╔══╝
███████║███████╗███████╗██║███████╗ ██║
██╔══██║╚════██║╚════██║██║╚════██║ ██║
██║ ██║███████║███████║██║███████║ ██║
╚═╝ ╚═╝╚══════╝╚══════╝╚═╝╚══════╝ ╚═╝
Tuya AI Innovators Hackathon 2025 — AI Agent Development Track
1–3 minute walkthrough of Rankify Assist: voice commands, browser automation, smart home control, and the safety-first confirmation system.
#TuyaOpen #TuyaAI #HackWithTuya #TuyaHackathon #TuyaDevelopers #TuyaGlobal
| Details | |
|---|---|
| Team Name | Rankify AI |
| Project Name | Rankify Assist |
| Track | AI Agent Development |
| Developer | Naman Dhakad — Solo developer, full-stack AI & IoT engineer |
Transform your voice into browser automation and smart home control
Built with safety-first architecture • Powered by Tuya AI • 100% Open Source
Today's voice assistants (Alexa, Google Home, Siri) are limited to predefined skills and cannot:
- ❌ Automate real browser tasks (checking emails, filling forms, web searches)
- ❌ Provide safety confirmation before executing critical actions
- ❌ Bridge IoT device control with web automation in a single unified interface
- ❌ Let users add custom automation without programming knowledge
Rankify Assist is the first voice AI system that combines browser automation, smart home control, and conversational AI with a mandatory safety-first confirmation protocol — all powered by the Tuya T5-E1 development board and TuyaOpen platform.
| User Segment | Use Case |
|---|---|
| 🧑💻 Productivity Workers | Hands-free email checking, web searches, form filling |
| 🏠 Smart Home Owners | Unified voice control for all Tuya-compatible devices |
| ♿ Accessibility Users | Voice-first interface for differently-abled individuals |
| 🔧 Developers & Makers | Extensible open-source platform to build custom AI hardware |
| 🏢 Enterprise Teams | Secure, confirmation-based automation for sensitive operations |
|
Voice → Action 100% Safe! |
Voice → Instant Lightning Fast! |
Voice → Answer Contextual! |
| Feature | Description | Status |
|---|---|---|
| 🎤 | Voice Control - Natural language commands via SmartLife app | ✅ |
| 🔒 | Safety First - Explicit confirmation for ALL browser actions | ✅ |
| 🌐 | Browser Automation - Gmail, YouTube, Google Search, any site! | ✅ |
| 💡 | Smart Home - Control lights, AC, locks, any Tuya device | ✅ |
| 🧠 | Conversational AI - Chat with memory and context | ✅ |
| 👥 | Multi-User - Google OAuth authentication | ✅ |
| ☁️ | Cloud Native - Always-on Vercel + Supabase | ✅ |
| 💰 | 100% FREE - Zero cost deployment | ✅ |
| 🔓 | Open Source - MIT License, all code included | ✅ |
graph LR
A[👤 You<br/>"Check Gmail"] --> B[🧠 AI Plans<br/>Browser Task]
B --> C[🔊 AI Asks<br/>"Proceed?"]
C -->|You: "Yes"| D[🌐 Browser Opens]
C -->|You: "No"| E[❌ Cancelled]
D --> F[📊 Result<br/>"5 Unread"]
F --> G[🔊 AI Speaks<br/>Result]
style A fill:#e1f5ff,stroke:#01579b,stroke-width:3px
style C fill:#fff3e0,stroke:#e65100,stroke-width:3px
style D fill:#e8f5e9,stroke:#2e7d32,stroke-width:3px
style E fill:#ffebee,stroke:#c62828,stroke-width:3px
style G fill:#f3e5f5,stroke:#4a148c,stroke-width:3px
graph LR
A[👤 You<br/>"Turn on lights"] --> B[🧠 AI<br/>Recognizes]
B --> C[⚡ Instant<br/>Execution]
C --> D[💡 Lights<br/>Turn On]
D --> E[🔊 AI Confirms<br/>"Done!"]
style A fill:#e1f5ff,stroke:#01579b,stroke-width:3px
style C fill:#fff3e0,stroke:#ff6f00,stroke-width:3px
style D fill:#e8f5e9,stroke:#2e7d32,stroke-width:3px
style E fill:#f3e5f5,stroke:#4a148c,stroke-width:3px
┌─────────────────────────────────────────────────────────┐
│ 🎤 SMARTLIFE APP │
│ "Your Voice Commands Here" │
└────────────────────┬────────────────────────────────────┘
│
↓
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ ☁️ TUYA AI WORKFLOW (Cloud) ┃
┃ ┌──────────────┬──────────────┬──────────────┐ ┃
┃ │ 🧠 Intent │ 🌐 Browser │ 🏠 IoT │ ┃
┃ │ Recognition │ Planner │ Controller │ ┃
┃ └──────────────┴──────────────┴──────────────┘ ┃
┗━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┛
│ │
┌────────────┴───┐ ┌───┴────────────┐
↓ ↓ ↓ ↓
┌────────────────┐ ┌────────────────┐ ┌────────────────┐
│ 🐍 Browser MCP │ │ 🐍 Device MCP │ │ 💬 Chat │
│ (Your PC) │ │ (Your PC) │ │ Direct Response│
└───────┬────────┘ └────────┬───────┘ └────────────────┘
│ │
↓ ↓
┌────────────────┐ ┌────────────────┐
│ 🚀 Vercel │ │ 🔌 Tuya API │
│ Cloud Bridge │ │ Smart Devices │
└───────┬────────┘ └────────────────┘
│
↓
┌────────────────┐
│ 🧩 Chrome Ext │
│ Your Browser │
└────────────────┘
🎯 Design Philosophy: Local MCP Servers + Cloud Bridge = Zero Cost + Maximum Control
Deploy Supabase
↓
Deploy Vercel
↓
Set Env Vars⏱️ 10 mins |
pnpm install
↓
pnpm build
↓
Load in Chrome⏱️ 5 mins |
Install SDK
↓
Configure .env
↓
Run Servers⏱️ 10 mins |
Say Command
↓
Confirm
↓
Watch Magic!⏱️ 5 mins |
AI Engine |
MCP Servers |
Cloud API |
Database |
Extension |
LLM Engine |
Authentication |
UI Framework |
MCP Protocol |
| Service | Free Tier | Your Usage | Monthly Cost |
|---|---|---|---|
| 🗄️ Supabase | 500MB DB, ∞ Requests | ~10MB | $0 |
| 🚀 Vercel | 100k Serverless Calls | ~1k | $0 |
| 🔌 Tuya IoT | 1000 API Calls/Day | ~50/day | $0 |
| 🐍 MCP Servers | Offline & Online | ~ no limit | $0 |
| 🧩 Extension | Chrome Only | Browser | $0 |
| 💎 TOTAL | $0/month |
| 🌐 Browser Commands | 🏠 Smart Home | 💬 Chat |
|---|---|---|
|
Instant execution! ⚡ |
Natural conversation! 💭 |
| # | Component | Exact Model | Purpose | Status |
|---|---|---|---|---|
| 1 | AI Core Board | Tuya T5-E1 AI Core Development Board | Voice capture, STT/TTS, cloud connectivity, DP management | ✅ |
| 2 | Microphone | Built-in 2-mic array (on T5-E1) | Voice input capture | ✅ |
| 3 | Speaker | Built-in 3W speaker (on T5-E1) | TTS audio output | ✅ |
| 4 | USB Cable | USB-C data cable | Firmware flashing & power | ✅ |
| 5 | Wi-Fi Router | Any 2.4GHz WPA2 router | Cloud connectivity | ✅ |
| 6 | Development PC | Windows 11 laptop | MCP servers, Chrome Extension, firmware build | ✅ |
| 7 | Smart Bulb (optional) | Any Tuya-compatible Wi-Fi LED bulb | IoT control demonstration | Optional |
| 8 | Smart Plug (optional) | Any Tuya-compatible Wi-Fi smart socket | Generic device control testing | Optional |
┌─────────────────────────────────────────────────────────────┐
│ 👤 USER (Voice) │
└───────────────────────┬─────────────────────────────────────┘
│ speaks
▼
┌─────────────────────────────────────────────────────────────┐
│ 🎙️ TUYA T5-E1 AI CORE BOARD │
│ ┌─────────────┐ ┌──────────────┐ ┌──────────────────┐ │
│ │ 2-Mic Array │→ │ Audio DSP │→ │ Wi-Fi 2.4/5GHz │ │
│ │ (Voice In) │ │ (Processing) │ │ (Cloud Connect) │ │
│ └─────────────┘ └──────────────┘ └────────┬─────────┘ │
│ ┌─────────────┐ │ │
│ │ 3W Speaker │← TTS Output │ │
│ │ (Audio Out) │ │ │
│ └─────────────┘ │ │
│ ┌─────────────┐ │ │
│ │ USB-C Port │← Firmware Flash / Power │ │
│ └──────┬──────┘ │ │
└─────────┼─────────────────────────────────────┼─────────────┘
│ │
│ USB-C Cable │ Wi-Fi (2.4GHz)
▼ ▼
┌──────────────────┐ ┌──────────────────────────┐
│ 💻 DEVELOPMENT PC │ │ 🌐 WI-FI ROUTER │
│ • MCP Servers │ │ (Internet Gateway) │
│ • Chrome + Ext │ └────────────┬─────────────┘
│ • Firmware Build │ │
└──────────────────┘ ▼
┌──────────────────────────┐
│ ☁️ TUYA CLOUD PLATFORM │
│ • AI Workflow Engine │
│ • STT/TTS Services │
│ • Device Management │
│ • MCP Gateway │
└────────────┬─────────────┘
│
┌────────────┴─────────────┐
▼ ▼
┌──────────────────┐ ┌──────────────────┐
│ 💡 Smart Bulb │ │ 🔌 Smart Plug │
│ (Tuya Wi-Fi) │ │ (Tuya Wi-Fi) │
└──────────────────┘ └──────────────────┘
┌─ RankifyAssist
│
├─📁 cloud-bridge/ 🚀 Vercel serverless API
│ ├─ api/ ├─ /execute, /poll, /result, /auth
│ ├─ lib/ ├─ Supabase client, auth helpers
│ ├─ public/ └─ Admin UI (config management)
│ └─ supabase-schema.sql 📝 Database schema
│
├─📁 mcp-servers/ 🐍 Python MCP servers (local files & HuggingFace online)
│ ├─ browser-automation/ ├─ WebSocket to Tuya Gateway
│ └─ device-controller/ └─ Calls Tuya OpenAPI
│
├─📁 extension-raw/ 🧩 Chrome extension source
│ ├─ chrome-extension/ ├─ Background scripts
│ └─ pages/ └─ Options UI, Side panel
│
├─📁 firmware/ 💻 T5 AI Core firmware (optional if u want own modification)
│ ├─ src/ ├─ Voice input, TTS output
│ └─ include/ └─ Device configuration
│
└─📁 docs/ 📖 Complete documentation
├─ deployment/ ├─ Quick start guides
├─ cloud-bridge/ ├─ Infrastructure docs
├─ mcp/ ├─ MCP setup
├─ extension/ ├─ Build guides
└─ workflow/ └─ Tuya AI configuration
| 📚 Topic | 🔗 Link | ⏱️ Time |
|---|---|---|
| Quick Start | Deploy in 30 mins | 30m |
| Architecture | System Design | 15m |
| MCP Setup | Configure MCPs | 20m |
| Extension | Build Guide | 10m |
| Workflow | Tuya Configuration | 25m |
| Checklist | Pre-commit | 5m |
| Feature | Implementation | Status |
|---|---|---|
| 🔐 Single ID Access | A single MCP Access ID connects whole mcp->server->database->extension | ✅ |
| 🔑 OAuth Authentication | Google OAuth 2.0 for secure login | ✅ |
| 🗄️ Encrypted Storage | Supabase RLS policies + encrypted credentials | ✅ |
| 🚫 No Data Collection | Zero telemetry, zero tracking | ✅ |
| 🔓 Open Source | Full code transparency | ✅ |
Every browser action requires explicit voice confirmation before execution. The system announces its plan ("I plan to open Gmail. Proceed?") and waits for the user to say "Yes" or "No". This prevents accidental or misinterpreted voice commands from causing unwanted actions.
- Edge (T5-E1 Board): Voice I/O, local keyword detection, TTS playback
- Cloud (Tuya Platform): AI intent classification, workflow orchestration, LLM processing
- Client (Chrome Extension): Browser automation execution via Eko Agent
- MCP Servers (Local PC): Secure bridge between Tuya Cloud and local resources
Designed to run entirely on free tiers: Supabase (database), Vercel (serverless API), Tuya Cloud (AI workflow), and local MCP servers — making it accessible to developers worldwide.
The visual workflow editor on Tuya Platform allows adding new intents (calendar, e-commerce, file management) without code changes. Each component (firmware, extension, MCP server) is independently deployable.
graph TB
subgraph USER["👤 User"]
Voice["🎤 Voice Command"]
end
subgraph HARDWARE["🎙️ Tuya T5-E1 Board"]
Mic["Mic Array"] --> DSP["Audio DSP"]
DSP --> WiFi["Wi-Fi Module"]
TTS["TTS Speaker"]
end
subgraph CLOUD["☁️ Tuya Cloud Platform"]
STT["STT Engine"] --> Workflow["AI Workflow"]
Workflow --> Intent{"Intent Router"}
Intent -->|Browser| BrowserLLM["Browser LLM"]
Intent -->|IoT| IoTCtrl["IoT Controller"]
Intent -->|Chat| ChatLLM["Chat LLM"]
MCP_GW["MCP Gateway"]
end
subgraph LOCAL["💻 Developer PC"]
BrowserMCP["🐍 Browser MCP Server"]
DeviceMCP["🐍 Device MCP Server"]
Bridge["🚀 Vercel Cloud Bridge"]
Ext["🧩 Chrome Extension"]
end
subgraph DEVICES["🏠 Smart Devices"]
Bulb["💡 Smart Bulb"]
Plug["🔌 Smart Plug"]
end
Voice --> Mic
WiFi --> STT
BrowserLLM --> MCP_GW
MCP_GW <--> BrowserMCP
MCP_GW <--> DeviceMCP
BrowserMCP --> Bridge --> Ext
DeviceMCP --> IoTCtrl
IoTCtrl --> Bulb
IoTCtrl --> Plug
ChatLLM --> TTS
Ext -->|Result| Bridge --> BrowserMCP --> MCP_GW --> TTS
TTS --> Voice
We ❤️ Contributions!
graph LR
A[🍴 Fork Repo] --> B[🌿 Create Branch]
B --> C[✏️ Make Changes]
C --> D[✅ Test Locally]
D --> E[📝 Commit]
E --> F[🚀 Push]
F --> G[📬 Pull Request]
G --> H[🎉 Merged!]
style A fill:#e3f2fd
style H fill:#c8e6c9
 AI Workflow Engine |
 Cloud Infrastructure |
 Serverless Platform |
 Firmware Framework |
📖 Quick Start Guide • 🏗️ Architecture • 📚 Full Docs
Built with ❤️ by the Rankify Assist Team
⭐ Star this repo if you find it useful! ⭐
