Skip to content
Metatext Decide — typed decisions for your agents, with a probability on every answerGet early access
Metatext
Sign Up

GhostHand

Windows desktop assistant that reads UI Automation controls and has Jev choose each action, pausing for approval before irreversible steps.

ServiceprototypeMIT
View on GitHub ↗

Overview

GhostHand is a Windows-native AI desktop assistant. Focus an app, press Ctrl+Win and describe what you want; it reads accessible controls through Windows UI Automation, has Jev (typesafe-ai/jev via Vercel AI Gateway) select the next action, then types, clicks and verifies the outcome in real time. Examples include writing an agenda in a text editor, calculating in Calculator and searching on Spotify.

Before any critical or irreversible step such as submit, send, pay, delete, post, install or confirm, it pauses and asks you to approve; routine steps run automatically, and pressing the chord again or Escape acts as a kill switch. It ships as a self-contained release that needs no .NET runtime, runs from the system tray, and includes a connection check. Configuration is an AI Gateway key with an optional zero-data-retention flag.

What the decision model decides

TypeQuestionAnswers
ChoiceWhich UI control and action should be used next?(inferred)—
Yes / noIs this step critical or irreversible and in need of approval?(inferred)yes · no

How it works

  1. User focuses an app and describes a task
  2. GhostHand reads UI Automation controls
  3. Jev chooses the next action; critical steps pause for approval
  4. Execute, verify and repeat

Strengths

  • Native Windows app with no runtime install
  • Human approval on irreversible actions
  • Kill switch

Caveats

  • Windows only
  • Requires a Vercel AI Gateway key
  • Early release (v0.1.0)

Getting started

Download the release zip, add AI_GATEWAY_API_KEY to .env, run CHECK_CONNECTION.bat, then START_GHOSTHAND.bat.

At a glance

Type
Service
Status
prototype
Language
C#
Runtime
Windows desktop app
Has code
yes
License
MIT

Use cases and integrations

How curated lists describe it

  • Windows desktop assistant: focus an app, press Ctrl+Win and describe the task; it reads UI Automation controls and has Jev choose each action through Vercel's AI Gateway, with human-in-the-loop checks.

    MrJev/awesome-jev

Frequently asked questions

What does Jev decide?

Which control to act on and what action to take next.

Will it pay or delete without asking?

No, critical and irreversible steps require approval.

How is Jev accessed?

Through Vercel AI Gateway.

Related projects

  • Footwork

    Verified computer-use agent: a Jev guard checks claimed completions and gates irreversible actions; Jev also takes simple steps.

    ProjectbetaPython
  • jev-adb

    MCP server that lets agents observe and control Android phones over ADB, with Jev picking controls and judging goal completion.

    MCP serverbetaTypeScript
  • kureksistant

    Voice assistant daemon for Hyprland Linux desktops that acts through tool modules, with Jev gating which requests and actions proceed.

    ProjectbetaPython
  • macos-computer-use-kit

    Accessibility-first macOS computer-use MCP server and CLI, with optional Jev guards on targets and inputs before irreversible actions.

    PluginbetaPython
  • tinycomputer

    Rust harness for desktop and browser automation where Jev answers small closed questions about the screen to pick each action.

    ProjectbetaRust
  • Jev-cu

    Codex computer-use skill where Jev picks the next on-screen element, action, completion and risk from text candidates.

    Agent skillprototypeJavaScript