Project overview
Midscene.js drives interfaces from screenshots, so tests can describe actions and assertions in natural language instead of depending on fragile DOM selectors. It can target visual states, canvas elements, native applications, and cross-origin surfaces that structure-based automation may miss. Use the JavaScript SDK, YAML workflows, or a Chrome extension across browsers, Android, iOS, HarmonyOS, desktop apps, and custom interfaces.
Repository facts
- Primary language
- TypeScript
- License
- MIT
- Repository updated
- Jul 14, 2026
- Default branch
- main
Resource types
SDKAutomationBrowser extension
Use cases
Testing and debugging
Operating systems
AndroidiOS
Capabilities
Verification and evalsWorkflow automation
Audience
Developers