SlimSnap is a macOS utility that converts screenshots into structured JSON data specifically built for AI coding agents. It solves the fundamental gap between visual screenshots and text-only terminal environments. Developers using Claude Code, Aider, Codex CLI, and other command-line agents often need to describe UI elements in tedious paragraphs because these agents cannot see images. SlimSnap bridges this by extracting every element's text, position, color, and bounding box into a deterministic JSON format. The core value proposition is that your AI finally has eyes — it can reason about specific buttons, input fields, and labels without guessing. This screenshot-to-JSON approach not only makes communication precise but also significantly reduces token consumption, letting agents spend more context on actual code rather than pixel interpretation.
The primary pain point SlimSnap addresses is the inability of terminal-based AI coding agents to accept image inputs. When a developer wants to discuss a UI element — say a misaligned button or an error message — they must write a lengthy text description of its appearance, location, and context. This is slow, imprecise, and often leads to agent confusion. Moreover, pasting screenshots into cloud-based models costs tokens proportional to the image size, even for small crops. SlimSnap eliminates this by producing a compact JSON representation that captures exactly what matters: element types, values, coordinates, and colors. For iterative debugging sessions, this translates to substantial time and cost savings. Developers can point at the broken thing with an annotation and paste structured data that the agent consumes instantly, without ambiguity about which element is which.
The SlimSnap workflow begins with capture. Users press ⌘⇧S, drag to select any screen area, and release — a native macOS interaction requiring no additional installation. The captured screenshot immediately opens in an editing interface where annotations can be added. Arrows, callouts, and highlights let users visually point at the exact element of interest, such as a broken button or an error state. This annotation step is crucial because it communicates intent directly within the visual data. The agent will see the annotation as part of the JSON, understanding which element was being highlighted. By combining capture and annotation in one seamless step, SlimSnap eliminates the need for separate image editing tools or verbose text explanations. The entire process takes seconds, keeping developers in their workflow.
After capture and annotation, a single click copies the entire scene as a JSON object. The JSON includes schema version, capture timestamp, screen metadata, and an array of elements — each with id, type, value, bounding box in normalized 0-to-1 coordinates, and optional color. This structured data is directly consumable by any text-based agent. The token savings are substantial: a typical screenshot in Claude Code bills 1,568 vision tokens per paste, whereas SlimSnap JSON of the same screen averages 600-800 tokens — about 55% fewer on Sonnet and up to 85% fewer on Opus 4.7 and 4.8. Over a long iterative session, these savings compound, freeing up context window space for actual code and reasoning. Pasting the JSON is as simple as typing text, enabling agents like Claude Code, Aider, and Codex CLI to instantly understand the UI layout.
admin
SlimSnap incorporates built-in optical character recognition that reads every label, button, and error message present in the captured screenshot. The OCR runs locally on the Mac, ensuring no data ever leaves the machine. Each recognized text element is included in the JSON with its precise bounding box coordinates, normalized to a 0-to-1 range relative to the capture area. This deterministic layout means the agent knows exactly where each element sits spatially, enabling it to reason about proximity, alignment, and hierarchy. For example, the agent can identify the second input field in the third card by its coordinates, rather than guessing based on pixel patterns. The JSON format also includes element type (label, input, button, etc.) and color information, giving the agent a complete map of the UI that is far more reliable than image-based vision.
SlimSnap follows a simple three-step workflow: Capture, Annotate, Export. After pressing the keyboard shortcut and selecting the area, users can optionally add visual annotations to highlight key elements. The final JSON is generated instantly, combining element data from OCR, user-added annotations, and metadata. This output can be pasted directly into any agent that accepts text input — terminals, SSH sessions, CI logs, git commits, or chat interfaces. The approach is fundamentally about transforming visual information into structured text that agents can parse efficiently. By stripping away pixel-level noise and focusing on semantic elements, SlimSnap ensures the agent's attention is directed to what matters: the actual UI components and their relationships. The local processing guarantees zero latency and total privacy, making it suitable for sensitive projects.
A common use case is debugging a UI bug: a developer captures a screenshot of the broken interface, annotates the offending element with an arrow, copies the JSON, and pastes it into Claude Code. The agent reads the error message from OCR, understands the element's position, and suggests a CSS fix or logic change. Another scenario is analyzing a signup form's field order; the JSON reveals the exact sequence and types of inputs, allowing the agent to generate appropriate form handling code. For dark mode testing, SlimSnap's OCR works identically, capturing labels that might be hard to see in a cropped image. The outcome is faster debugging cycles, fewer ambiguous text descriptions, and more accurate agent actions. Developers report that agent responses become more precise because the JSON gives explicit coordinates rather than relying on vague spatial descriptions like 'the button below the login field'.
SlimSnap is designed for developers who use AI coding agents in their terminal workflow — particularly those leveraging Claude Code, Aider, Codex CLI, Cursor, or Continue.dev. It is most valuable for frontend engineers, full-stack developers, and QA professionals who frequently need to communicate UI state to their agent. The app runs exclusively on macOS; there are no plans for Windows or Linux yet, though demand signals may change that. The JSON schema is published under MIT license on GitHub, allowing community extensions and custom exporters. SlimSnap is free to download and use without registration or account creation. No uploads, no servers, total privacy. With its token-saving efficiency and deterministic UI representation, SlimSnap gives terminal-bound coding agents the visual context they need to work effectively, transforming how developers interact with their tools.
SlimSnap is designed for developers who rely on AI coding agents in their terminal workflow, particularly those using Claude Code, Aider, and Codex CLI. It serves frontend engineers who need to describe UI states, full-stack developers debugging interfaces, QA professionals capturing error scenarios, and anyone who wants to reduce token costs while giving their agent precise visual context. The tool is ideal for macOS users who value local processing and privacy, and for teams looking to integrate structured UI data into automated workflows. SlimSnap is not for casual screenshot sharing but for power users who need deterministic, machine-readable representations of screen content.