OpenAI unveils Operator – an AI assistant

OpenAI has introduced a new feature called Operator. The digital assistant that can complete tasks on a computer in the same way humans do. Powered by a model named Computer-Using Agent (CUA), this AI is designed to use a mouse and keyboard, interact with screens, and handle tasks like browsing websites or filling out forms without needing any special programming or shortcuts. Operator combines vision and reasoning to get things done.

The standout capability of CUA is its flexibility. Instead of relying on pre-built tools or coded instructions, it interacts directly with the buttons, menus, and forms on your screen, just like a human. This makes it much more adaptable, enabling it to tackle a wide variety of tasks across different applications and websites.

How does Operator work?

First, it “sees” the screen by processing screenshots to understand what’s happening. Then, it plans the next steps, like deciding what to click or type. Finally, it takes action, completing tasks using a virtual mouse and keyboard.

Also Read: OpenAI announces new initiative 'The Stargate Project'

For example, when Operator is asked to fill out an online form, it will look at the form, figure out the correct fields to fill, and type in the necessary information step by step. If something goes wrong—like a button not working—it can adapt and try a different approach.

However, it’s cautious about sensitive tasks. For actions like entering passwords or confirming purchases, it pauses and asks for your approval before moving forward.