According to 1M AI News, open-source developer Tommaso De Rossi has released usecomputer, a desktop automation command-line tool written in Zig that generates native binaries without requiring a Node.js runtime, enabling AI programming assistants (such as Claude Code, Codex, and OpenCode) to directly control the mouse, keyboard, and take screenshots on the desktop. It supports macOS and Linux (X11; Wayland via XWayland compatibility).
usecomputer provides CLI commands for screenshots, mouse movements/clicks/dragging/scrolling, keyboard input, and shortcut key combinations, along with a coordinate mapping system (coord-map) that automatically converts pixel coordinates from screenshots into actual screen coordinates. Screenshot output is scaled by default so that the longest side is 1568 pixels to fit the model's context window. The tool also supports the Kitty Graphics Protocol; after setting the environment variable, screenshots can be directly embedded into the model's context without requiring additional file reading.
De Rossi previously developed the browser automation tool Playwright (3200+ GitHub stars); usecomputer extends browser automation to desktop automation. The project was split out from its kimaki monorepo and provides both a CLI and a Node.js library. The README includes complete integration examples for OpenAI computer tool and Anthropic computer use.
Use the Computer CLI Tool for Desktop Automation—Open-Sourced and Compatible with Claude Code and Codex
KuCoinFlashShare
Summary
UseComputer, a CLI tool for desktop automation, has been open-sourced by developer Tommaso De Rossi. Built in Zig, it enables AI programming assistants like Claude Code and Codex to control the mouse, keyboard, and screenshots. The protocol update supports macOS and Linux (X11, Wayland via XWayland), with features such as coordinate mapping and inline screenshot handling via the Kitty Graphics Protocol. This AI + crypto news represents a step forward in integrating automation with AI tools.
Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information.
Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.