vercel-labs/agent-desktop
agent-desktop is a Rust computer use CLI for AI agents to operate desktop apps on macOS, Windows, and Linux via the OS accessibility tree.
14.4k · Rust
It bridges LLMs directly to native UI components instead of guessing coordinates from blurry screenshots. For installation, https://www.npmjs.com/package/agent-desktop gets you the package to start wiring up your automated desktop agents.