A computer use agent receives a screenshot and proposes actions such as clicks and typing for an application to execute. The application returns a new screenshot so the agent can inspect the result.
The demo observes a fictional settings screen, clicks a toggle, then checks the changed state. Coordinate mistakes and unexpected UI states call for an isolated environment and separate approval for sensitive actions.
When to use
Use it for UI work without a suitable API when the result must be verified on screen.