Openclick

What is Openclick?

Openclick is an experimental, MIT-licensed command-line tool that connects a large language model to the macOS Accessibility APIs. You write a prompt, the model proposes a plan of UI actions, and Openclick executes that plan against whatever app exposes an accessibility tree.

How it works

• Prompts, not scripts — Describe what you want in plain language; the model emits a plan of clicks, keystrokes, and AX reads.
• Plan. Confirm. Run. — The plan is printed before anything executes. You can read it, edit it, or abort. --dry-run is the default, and every AX call is logged.
• Bring your own model — OpenAI, Anthropic, DeepSeek, or any compatible endpoint. Local models via Ollama or LM Studio. No bundled keys.
• Flexible shape — Use it from your shell, a menu bar app, or as a long-running daemon for scripts and hooks.
• Local by default — No accounts, no telemetry. Prompts and screen contents stay on your Mac unless you point it at a cloud model.

Example prompts

openclick "reply to anything from sarah marked urgent, draft only"
openclick "sort my downloads folder by file type into subfolders"
openclick "find the cheapest flight SFO→TYO next month, save tabs"
openclick "block 2hr deep work tomorrow morning, decline conflicts"

Requirements

Node 20+ and accessibility permission. Early and rough — expect rough edges. Issues and PRs are welcome, but no roadmap promises.