AI for Developers
Midscene.js logo

Midscene.js

Visit Website

Vision-driven UI automation that lets AI operate web, Android and iOS interfaces from natural-language instructions.

Midscene.js is an open-source (MIT) GUI agent and natural-language testing framework for web, mobile and desktop apps. A single API works across Web, Android, iOS, HarmonyOS and desktop.

You write actions and assertions in plain language (aiAct, aiWaitFor, aiAssert) in YAML or JavaScript. It includes a YAML test framework with lifecycle hooks, retries, concurrency and HTML step reports, and custom TypeScript nodes for business logic. Web tests can use PlaywrightAgent with Playwright Test.

See the Get started guide on midscenejs.com for setup. It uses a vision model to read the screen, so you choose and supply the model.

Midscene.js reviews

  • No reviews yet.
See something outdated? Suggest an update