Graphics & Screen Automation
Graphics and screen automation refers to using image recognition combined with simulated keyboard and mouse operations to automate desktop applications.
- Image Automation
- Virtual Controls
- Optical Character Recognition (OCR)
- Image Operation API
- Desktop Operation API
- Walkthrough: Creating Image Automation Tests
- Walkthrough: Creating Image Automation Project for Match-3 Game
Among these, Image Automation uses image matching to locate and operate controls; Virtual Controls defines specific areas on the screen or application as controls; Optical Character Recognition (OCR) uses optical character recognition to identify screen content as text and perform operations on corresponding positions; Desktop Operation API directly performs keyboard and mouse operations on screen coordinates.