xiry.

AI · Desktop app

Ace

Realtime desktop autopilot that controls mouse and keyboard for native apps.

From the Xiry library · Updated 3 October 2026

Visit generalagents.com ↗

Ace is an autonomous computer-use agent by General Agents designed to interact with your operating system via mouse clicks and keyboard strokes. It focuses on low-latency action prediction (sub-second response times), allowing it to automate tasks across native desktop applications as well as browsers.

What it's for

  • Automate repetitive workflows across desktop applications like video editors and code editors
  • Navigate desktop interfaces and trigger sequences of clicks and keystrokes from natural language prompts
  • Delegate multi-step cross-application computer tasks

Features

  • Native mouse and keyboard execution directly on the desktop interface
  • Low-latency action predictions with small and medium model variants (300-500ms range)
  • Spotlight-style command-bar launcher triggered by a hotkey
  • Trained on over a million computer use tasks
  • Cross-software compatibility working outside the confines of web browsers

Details

Type
Desktop app
Category
AI
Topic
Computer Use Agents
Open source
No
Platforms
macOS, Windows
For
Power users, developers, and professionals looking for system-level desktop automation.
Alternative to
OpenAI Operator, Anthropic Computer Use
Tags
computer use, desktop agent, automation, autopilot, ai agents

Why it was saved

  • @victor__martynov, 6 June 2025: Unlike browser-only automation agents, it operates system-wide (e.g., editing video inside Adobe Premiere Pro, coding in VS Code) significantly faster than alternatives like OpenAI Operator.

Compare

Related

  • ACU - Awesome Agents for Computer Use

    Curated collection of papers, tools, and frameworks for computer-controlling AI agents

  • Google Opal

    No-code visual canvas for building AI mini-apps from plain English prompts

  • Hermes Agent

    Open-source, self-hosted AI agent with persistent memory and messaging integrations.

  • Agent S

    Open-source computer use agent operating GUI interfaces via mouse and keyboard

  • Autotab

    AI computer-use agent that learns and automates browser tasks by demonstration

  • awesome-claude-skills

    Curated collection of skills, tools, and plugins for Claude workflows

Updated