Steward records your screen interactions, builds visual workflows, and replays them with pixel-level verification — repairing itself when things change.
Steward combines screen recording, visual verification, and self-repair into a single native macOS experience.
Record screen interactions with pixel-level precision. Every click, keystroke, and scroll is captured with full context — app name, window title, and accessibility metadata.
Recordings are automatically decomposed into discrete, verifiable steps. Each step knows exactly what it expects — and can prove it happened.
Every replayed step is verified against the expected end-state using real screenshots. Steward doesn't just click — it confirms the click worked.
When a UI changes, Steward pauses and lets you guide it to the new target. It learns the fix and applies it to future runs — no re-recording needed.
Built entirely in Swift and SwiftUI. No Electron, no web views. A true Mac-native app with liquid glass design, neumorphic panels, and system integration.
All data stays on your machine. Recordings, workflows, and screenshots are stored locally. No cloud uploads, no telemetry, no tracking.
Three steps to turn any manual desktop task into a reliable, self-healing automation.
Click record and perform the task normally. Steward captures every interaction with OpenAdapt — mouse movements, clicks, keystrokes, scrolls — alongside continuous accessibility context sampling at 250ms intervals.
Steward's derivation engine transforms the raw trace into a literal workflow — a sequence of discrete steps with typed actions, interaction surfaces, target crops, and verification expectations.
Peekaboo replays the workflow step by step, verifying each action's outcome against the expected state. If a target moves or a UI changes, Steward pauses for a guided repair — then remembers the fix.
Steward orchestrates three specialized services to deliver reliable desktop automation.
Recording Engine
Captures raw screen interactions — pointer movements, clicks, keystrokes, and scrolls — into a structured trace database. Python-based runtime with managed virtual environment.
Replay Engine
Executes literal workflows step by step using accessibility APIs and coordinate-based interaction. Verifies each step's outcome with screenshot comparison and state matching.
Memory Engine
Provides ambient screen context for failure analysis. When a step fails, Steward queries Screenpipe for recent screen text and application state to help diagnose the issue.
A liquid glass interface that keeps things minimal while surfacing every detail that matters.
Workflow Editor — Visual step timeline with inspector
Recording — Live capture with permissions panel
Run — Live progress with step receipts
Steward is currently in private development. Join the waitlist to get notified when early access opens.
No spam. We'll only email you when Steward is ready.