Skip to content

Desktop and mobile control with decision models

Picking the next control and action from accessibility trees, OCR output or screenshots to drive desktop and phone apps.

76 public projects · page 2 of 3

  • Slack-like playground for watching computer-use agents work, with replays, comparable runs and Jev choosing from a menu of visible actions.

    ProjectbetaTypeScript
  • Prebuilt browser, computer-use, robotics and game agents whose actions come from Jev, Laya or Cua-S1, with a scaffold for new agents.

    ProjectbetaPython
  • Rust harness for desktop and browser automation where Jev answers small closed questions about the screen to pick each action.

    ProjectbetaRust
  • macOS computer-use loop that OCRs the screen, has Jev pick the next action from a short list, and clicks, at about $0.0002 a step.

    ProjectbetaPython
  • Windows automation and durable research MCP server for Codex and Claude Code where Jev chooses among bounded UI Automation actions.

    MCP serverbeta
  • MCP server that drives an Android phone over adb: it reads the screen, asks Jev the next action, acts, and reports if the goal was met.

    ServiceprototypePython
  • Go macOS controller where Jev picks the next accessibility action, the target element and whether the goal is done.

    ProjectprototypeGo
  • macOS command palette that asks Jev one yes/no per menu item and presses the best match for your plain-language request.

    ServiceprototypeSwift
  • Windows desktop assistant that reads UI Automation controls and has Jev choose each action, pausing for approval before irreversible steps.

    ServiceprototypeC#
  • Screenshot-in, coordinate-out harness where Jev picks among vision-described grid tiles recursively, with probability and margin gates.

    ProjectprototypePython
  • Windows and Chrome GUI delegation for Codex: a local controller runs a task contract, calling Jev only for semantic choices.

    ProjectprototypePython
  • Talk to your Mac: local whisper.cpp transcribes, one Jev request picks the action and typed arguments, and code executes macOS automation.

    ProjectprototypePython
  • Floating macOS bar for voice or text commands where Jev picks the next action from live accessibility controls in a loop.

    ProjectprototypeSwift
  • Codex computer-use skill where Jev picks the next on-screen element, action, completion and risk from text candidates.

    Agent skillprototypeJavaScript
  • Game agent claiming to combine local Laya reflexes with Jev strategy to play PC and Android games via screen capture and real inputs.

    ProjectprototypePython
  • Android agent where one Jev request per step picks an operation and target from the accessibility tree, with a vision fallback.

    ProjectprototypePython
  • Android control prototype with three agents: vision model, text-only supervisor, and Jev choosing actions and checking completion.

    ProjectprototypePython
  • Single-file MCP server giving coding agents typed, budgeted Jev control over the iOS Simulator with gated destructive actions.

    MCP serverprototypeJavaScript
  • macOS voice and typed computer-use app where Jev picks the next on-screen action from the Accessibility tree, with no screenshots.

    AppprototypeSwift
  • Pre-alpha Rust and Tauri voice control layer for macOS that reads the accessibility tree; Jev is a fallback rather than the router.

    ProjectprototypeRust
  • Windows UI Automation backend for arc-cua that lets a planner hand off desktop subtasks to a Jev-driven click-and-type loop.

    PluginprototypePython
  • Electron app for controlling Windows 10/11 by Turkish or English speech, using OpenAI Realtime, Jev decisions, UI Automation and Playwright.

    ProjectprototypeTypeScript
  • Mac desktop pet agent that does tasks across files, apps and websites, using Jev alone for file chores and an LLM for open-ended work.

    AppprototypeTypeScript
  • Voice-controlled Mac agent where Jev picks the tool and its arguments in about 300 ms, running AppleScript or driving Chrome.

    ProjectprototypePython
  • On-device Android agent that taps any app, with an allow/confirm/block safety gate optionally backed by Jev or Laya.

    ServiceprototypeKotlin
  • Phone agent where Jev picks one operation and one element from an indexed accessibility table; code does the tap.

    ProjectprototypePython
  • Desktop computer-use agent for macOS and Windows where Jev chooses each concrete native action, with optional GPT-6 Astra planning.

    Projectprototype
  • Reference framework where Jev picks a concrete computer-use action and its execution route from legal, verifiable candidates.

    AppresearchPython
  • From-scratch research reconstruction of a small System-One decision model, used to route and gate commands in a Windows palette.

    ProjectresearchPython
  • Python tap SDK for Android, iOS and HarmonyOS where multimodal Jev picks a numbered on-screen candidate and the SDK taps it.

    LibrarybetaPython