app/computer-use.md +41 −21
1# Computer Use – Codex app1# Computer Use – Codex app
2 2
33In the Codex app, computer use is currently available on macOS, except in theIn the Codex app, computer use is available on macOS and Windows, except in
44European Economic Area, the United Kingdom, and Switzerland at launch. Installthe European Economic Area, the United Kingdom, and Switzerland at launch.
55the Computer Use plugin, then grant Screen Recording and AccessibilityInstall the Computer Use plugin. On macOS, grant Screen Recording and
66permissions when macOS prompts you.Accessibility permissions when prompted.
7 7
88With computer use, Codex can see and operate graphical user interfaces on macOS.With computer use, Codex can see and operate graphical user interfaces on macOS
99Use it for tasks where command-line tools or structured integrations aren’tor Windows. Use it for tasks where command-line tools or structured integrations
1010enough, such as checking a desktop app, using a browser, changing app settings,aren’t enough, such as checking a desktop app, using a browser, changing app
1111working with a data source that isn’t available as a plugin, or reproducing asettings, working with a data source that isn’t available as a plugin, or
1212bug that only happens in a graphical user interface.reproducing a bug that only happens in a graphical user interface.
13 13
14Because computer use can affect app and system state outside your project14Because computer use can affect app and system state outside your project
15workspace, use it for scoped tasks and review permission prompts before15workspace, use it for scoped tasks and review permission prompts before
18## Set up computer use18## Set up computer use
19 19
20In Codex settings, open **Computer Use** and click **Install** to install the20In Codex settings, open **Computer Use** and click **Install** to install the
2121Computer Use plugin before you ask Codex to operate desktop apps. When macOSComputer Use plugin before you ask Codex to operate desktop apps. On Windows,
2222prompts for access, grant Screen Recording and Accessibility permissions if youkeep the target app visible on the active desktop while the task runs. On
2323want Codex to see and interact with the target app.macOS, grant Screen Recording and Accessibility permissions when prompted so
24Codex can see and interact with the target app.
24 25
2526To use computer use, grant:On macOS, grant:
26 27
27- **Screen Recording** permission so Codex can see the target app.28- **Screen Recording** permission so Codex can see the target app.
28- **Accessibility** permission so Codex can click, type, and navigate.29- **Accessibility** permission so Codex can click, type, and navigate.
34 35
35Good fits include:36Good fits include:
36 37
3738- Testing a macOS app, an iOS simulator flow, or another desktop app that Codex- Testing a macOS app, Windows app, iOS simulator flow, or another desktop app
3839 is building. that Codex is building.
39- Performing a task that requires your web browser.40- Performing a task that requires your web browser.
40- Reproducing a bug that only appears in a graphical interface.41- Reproducing a bug that only appears in a graphical interface.
41- Changing app settings that require clicking through a UI.42- Changing app settings that require clicking through a UI.
42- Inspecting information in an app or data source that isn’t available through a43- Inspecting information in an app or data source that isn’t available through a
43 plugin.44 plugin.
4445- Running a scoped task in the background while you keep working elsewhere.- On macOS, running a scoped task in the background while you keep working
46 elsewhere.
45- Executing a workflow that spans more than one app.47- Executing a workflow that spans more than one app.
46 48
47For web apps you are building locally, use the49For web apps you are building locally, use the
48[in-app browser](https://developers.openai.com/codex/app/browser) first.50[in-app browser](https://developers.openai.com/codex/app/browser) first.
49 51
52### Windows foreground use
53
54On Windows, computer use runs on the active desktop. It can’t operate in the
55background while you keep using the same Windows session, so expect Codex to
56move the pointer, type, and take over the foreground while the task runs.
57
58For Windows tasks that should continue while you step away, keep the Windows
59device unlocked and connected to the internet. Use
60[remote control](https://developers.openai.com/codex/remote-connections) from your phone to check progress
61or send follow-up instructions, or run the Codex app inside a Windows virtual
62machine so computer use takes over the VM instead of your main desktop.
63
50## Start a computer use task64## Start a computer use task
51 65
52Mention `@Computer` or `@AppName` in your prompt, or ask Codex to use66Mention `@Computer` or `@AppName` in your prompt, or ask Codex to use
68 82
69## Permissions and approvals83## Permissions and approvals
70 84
7185The macOS system permissions for computer use are separate from app approvals inSystem permissions for computer use are separate from app approvals in Codex.
7286Codex. The macOS permissions let Codex see and operate apps. App approvalsOn macOS, Screen Recording and Accessibility permissions let Codex see and
7387determine which apps you allow Codex to use. File reads, file edits, and shelloperate apps. App approvals determine which apps you allow Codex to use. File
7488commands still follow the sandbox and approval settings for the thread.reads, file edits, and shell commands still follow the sandbox and approval
89settings for the thread.
75 90
76With computer use, Codex can see and take action only in the apps you allow.91With computer use, Codex can see and take action only in the apps you allow.
77During a task, Codex asks for your permission before it can use an app on your92During a task, Codex asks for your permission before it can use an app on your
85 100
86If Codex can’t see or control an app, open **System Settings > Privacy &101If Codex can’t see or control an app, open **System Settings > Privacy &
87Security** and check **Screen Recording** and **Accessibility** for the Codex102Security** and check **Screen Recording** and **Accessibility** for the Codex
88103app.app on macOS. On Windows, make sure the target app is visible in the active
104desktop session.
89 105
90## Locked use106## Locked use
91 107
108Locked use is for macOS. On Windows, computer use works in the foreground.
109
92Locked computer use lets Codex use Computer Use after your Mac locks, but only110Locked computer use lets Codex use Computer Use after your Mac locks, but only
93after you enable it. Use it when a Codex task needs to use desktop apps from a111after you enable it. Use it when a Codex task needs to use desktop apps from a
94connected device after the Mac locks.112connected device after the Mac locks.
135- Give Codex one clear target app or flow at a time.153- Give Codex one clear target app or flow at a time.
136- You can stop the task or take over your computer at any time.154- You can stop the task or take over your computer at any time.
137- Keep sensitive apps closed unless they’re required for the task.155- Keep sensitive apps closed unless they’re required for the task.
156- On Windows, expect Codex to take over foreground input while it works; use a
157 secondary device, a VM, or stop the task before using that desktop yourself.
138- Avoid tasks that require secrets unless you’re present and can approve each158- Avoid tasks that require secrets unless you’re present and can approve each
139 step.159 step.
140- Review app permission prompts before allowing Codex to use an app.160- Review app permission prompts before allowing Codex to use an app.