Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目，支持在 Mac mini/MacBook 上或通过算力棒本地运行推理，实现纯视觉驱动的跨平台 GUI 自动化操作。数据完全本地处理，支持复杂多步骤任务规划与执行。

State of the Art 82% OSWorld Verified Computer Using Agent, fully open-source, safe, auditable, and production-ready.

🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/

AutoNode: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation

PyBreeze features built-in modules tailored for every level of modern automation, allowing developers to tackle complex scenarios without leaving the IDE.

A framework for GUI automation

Fully localized Robot Framework library for automating the SAP GUI using text locators

[ACL 2026 Main] Official repository for paper: OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agents

Command Line telepathy. An Autonomous Al Agent for your Terminal that turns intent into Execution (Windows/Linux/Mac)

Nim GUI Automation Linux, simulate user interaction, mouse and keyboard.

Computer Use Protocol is a universal schema for AI agents to perceive and interact with any desktop UI.

Autonomous GUI agent — give it a task, it operates the desktop. Visual memory, one-shot UI learning. | 自主GUI代理——给它一个任务，它操作桌面。视觉记忆，一次学习即可操作。

Desktop automation library for Ruby

GUI automation toolkit for Rust

MCP server for Linux desktop GUI automation on KDE Plasma 6 Wayland -- 30 tools for virtual and live sessions

Windows backend input automation library in Go (Message + HID). A Go wrapper over Interception for reliable Windows input automation. 基于内核驱动级的 Windows RPA 自动化 输入注入库

This project automates the conversion of Figma designs into code, supporting frameworks like Tkinter, Kivy, PyQt5, Java Swing, and C++ QT. It streamlines UI development by transforming design files into fully functional, customizable code while preserving the original layout, colors, fonts, and components.

Give OpenClaw the power to control your desktop — UI-TARS VLM-driven GUI automation

Lightcone: SDK for computer use agents

MaskClaw项目构建了一套基于端侧多模态大模型的自进化隐私防护架构，通过视觉脱敏与Agentic 规则演进，实现了 Agent 行为偏好与隐私防护策略的动态协同生长，确保了高危隐私数据在云端交互中的物理级安全与个体化适配。