Introduction

Modules

This list gives an overview on currently implemented and planned functionality.

Clipboard

Copy text to clipboard
Paste text from clipboard

Keyboard

Support for standard US keyboard layout
Support for multimedia keys

Mouse

Support for mouse movement
Support for mouse scroll
Configurable movement speed
Mouse drag

Window

List all windows
Retrieve active window
Retrieve window title
Retrieve window size and position
Focus a particular window
Resize a window
Reposition a window
Minimize a window (*)
Restore a window (*)
Inspect GUI elements of a window (*)
Search for specific GUI elements of a window (*)

(*) Requires an additional provider package, visit the plugin page for more info

Screen

Retrieve RGBA color information on screen
Highlighting screen regions
Find a single or multiple occurrences of an image on screen (*)
Wait for an image to appear on screen (*)
Find a single or multiple occurrences of text on screen (*)
Wait for a piece of text to appear on screen (*)
Find a single or multiple windows on screen (*)
Wait for a window to appear on screen (*)
Hooks to trigger actions based on detected text, images or windows (*)

(*) Requires an additional provider package, visit the plugin page for more info

Integration

Jest
Electron
Custom log integration
Previous
Getting help