1# Computer Use1# Computer Use
2 2
3In supported regions, computer use in the Codex app is available on macOS and3In supported regions, Computer Use in the ChatGPT desktop app is available on
4 Windows. Install the Computer Use plugin. On macOS, grant Screen Recording and4 macOS and Windows in ChatGPT Work and Codex. Install the Computer Use plugin.
5 Accessibility permissions when prompted.5 On macOS, grant Screen Recording and Accessibility permissions when prompted.
6 6
7With computer use, Codex can see and operate graphical user interfaces on macOS7With Computer Use, ChatGPT can see and operate graphical user interfaces on macOS
8or Windows. Use it for tasks where command-line tools or structured integrations8or Windows. Use it for tasks where command-line tools or structured integrations
9aren't enough, such as checking a desktop app, using a browser, changing app9aren't enough, such as checking a desktop app, using a browser, changing app
10settings, working with a data source that isn't available as a plugin, or10settings, working with a data source that isn't available as a plugin, or
11reproducing a bug that only happens in a graphical user interface.11reproducing a bug that only happens in a graphical user interface.
12 12
13Because computer use can affect app and system state outside your project13Because Computer Use can affect app and system state outside your project
14workspace, use it for scoped tasks and review permission prompts before14workspace, use it for scoped tasks and review permission prompts before
15continuing.15continuing.
16 16
17## Set up computer use17## Set up Computer Use
18 18
19In Codex settings, open **Computer Use** and click **Install** to install the19In the ChatGPT desktop app, select Work or Codex. Open **Plugins > Computer
20Computer Use plugin before you ask Codex to operate desktop apps. On Windows,20Use** and select **Install plugin** if prompted. If ChatGPT shows **Enable**,
21keep the target app visible on the active desktop while the task runs. On21select it. Turn on the Computer Use server and skill toggles, then select **Try
22macOS, grant Screen Recording and Accessibility permissions when prompted so22now** to start.
23Codex can see and interact with the target app.23
24<Illustration description="Computer Use plugin controls with the MCP server and skill enabled.">
25 <ComputerUsePluginSetupIllustration ariaLabel="Computer Use plugin controls with the MCP server and skill enabled." />
26</Illustration>
27
28Then open **Settings > Computer use** to review app access. Connected browser
29controls show a **Manage** action. Apps you approve for future tasks appear in
30the **Always-allowed apps** section.
31
32<Illustration description="Computer Use settings showing app controls and Calculator as the only always-allowed app.">
33 <ComputerUseSettingsIllustration ariaLabel="Computer Use settings showing app controls and Calculator as the only always-allowed app." />
34</Illustration>
35
36On Windows, keep the target app visible on the active desktop while the task
37runs. On macOS, grant Screen Recording and Accessibility permissions when
38prompted so ChatGPT can see and interact with the target app.
24 39
25On macOS, grant:40On macOS, grant:
26 41
27- **Screen Recording** permission so Codex can see the target app.42- **Screen Recording** permission so ChatGPT can see the target app.
28- **Accessibility** permission so Codex can click, type, and navigate.43- **Accessibility** permission so ChatGPT can click, type, and navigate.
29 44
30## When to use computer use45## When to use Computer Use
31 46
32Choose computer use when the task depends on a graphical user interface that's47Choose Computer Use when the task depends on a graphical user interface that's
33hard to verify through files or command output alone.48hard to verify through files or command output alone.
34 49
35Good fits include:50Good fits include:
36 51
37- Testing a macOS app, Windows app, iOS simulator flow, or another desktop app52- Testing a macOS app, Windows app, iOS simulator flow, or another desktop app
38 that Codex is building.53 that ChatGPT is building.
39- Performing a task that requires your web browser.54- Performing a task that requires your web browser.
40- Reproducing a bug that only appears in a graphical interface.55- Reproducing a bug that only appears in a graphical interface.
41- Changing app settings that require clicking through a UI.56- Changing app settings that require clicking through a UI.
46- Executing a workflow that spans more than one app.61- Executing a workflow that spans more than one app.
47 62
48For web apps you are building locally, use the63For web apps you are building locally, use the
49[in-app browser](https://developers.openai.com/codex/app/browser) first.64[built-in browser](https://learn.chatgpt.com/docs/browser?surface=app) first.
50 65
51### Windows foreground use66### Windows foreground use
52 67
53On Windows, computer use runs on the active desktop. It can't operate in the68On Windows, Computer Use runs on the active desktop. It can't operate in the
54background while you keep using the same Windows session, so expect Codex to69background while you keep using the same Windows session, so expect ChatGPT to
55move the pointer, type, and take over the foreground while the task runs.70move the pointer, type, and take over the foreground while the task runs.
56 71
57For Windows tasks that should continue while you step away, keep the Windows72For Windows tasks that should continue while you step away, keep the Windows
58device unlocked and connected to the internet. Use73device unlocked and connected to the internet. Use
59[remote control](https://developers.openai.com/codex/remote-connections) from your phone to check progress74[remote control](https://learn.chatgpt.com/docs/remote-connections) from your phone to check progress
60or send follow-up instructions, or run the Codex app inside a Windows virtual75or send follow-up instructions, or run the ChatGPT desktop app inside a Windows virtual
61machine so computer use takes over the VM instead of your main desktop.76machine so Computer Use takes over the VM instead of your main desktop.
62 77
63## Start a computer use task78## Start a Computer Use task
64 79
65Mention `@Computer` or `@AppName` in your prompt, or ask Codex to use80Mention `@Computer` or `@AppName` in your prompt, or ask ChatGPT to use Computer
66computer use. Describe the exact app, window, or flow Codex should operate.81Use. Describe the exact app, window, or flow ChatGPT should operate.
67 82
68```text83```text
69Open the app with computer use, reproduce the onboarding bug, and fix the84Open the app with Computer Use, reproduce the onboarding bug, and fix the
70smallest code path that causes it. After each change, run the same UI flow85smallest code path that causes it. After each change, run the same UI flow
71again.86again.
72```87```
77 92
78If the target app exposes a dedicated plugin or MCP server, prefer that93If the target app exposes a dedicated plugin or MCP server, prefer that
79structured integration for data access and repeatable operations. Choose94structured integration for data access and repeatable operations. Choose
80computer use when Codex needs to inspect or operate the app visually.95Computer Use when ChatGPT needs to inspect or operate the app visually.
81 96
82## Permissions and approvals97## Permissions and approvals
83 98
84System permissions for computer use are separate from app approvals in Codex.99System permissions for Computer Use are separate from app approvals in ChatGPT.
85On macOS, Screen Recording and Accessibility permissions let Codex see and100On macOS, Screen Recording and Accessibility permissions let ChatGPT see and
86operate apps. App approvals determine which apps you allow Codex to use. File101operate apps. App approvals determine which apps you allow ChatGPT to use. File
87reads, file edits, and shell commands still follow the sandbox and approval102reads, file edits, and shell commands still follow the sandbox and approval
88settings for the thread.103settings for the task.
89 104
90With computer use, Codex can see and take action only in the apps you allow.105With Computer Use, ChatGPT can see and take action only in the apps you allow.
91During a task, Codex asks for your permission before it can use an app on your106During a task, ChatGPT asks for your permission before it can use an app on your
92computer. You can choose **Always allow** so Codex can use that app in the future107computer. You can choose **Always allow** so ChatGPT can use that app in the future
93without asking again. You can remove apps from the **Always allow** list in the108without asking again. You can remove apps from the **Always allow** list in the
94**Computer Use** section of Codex settings.109**Computer Use** section of the ChatGPT desktop app settings.
95 110
96<CodexScreenshot111<CodexScreenshot
97 alt="Codex app asking for permission to use Calculator with computer use"112 alt="ChatGPT desktop app asking for permission to use Calculator with Computer Use"
98 lightSrc="/images/codex/app/computer-use-approval-light.webp"113 lightSrc="/images/codex/app/computer-use-approval-light.webp"
99 darkSrc="/images/codex/app/computer-use-approval-dark.webp"114 darkSrc="/images/codex/app/computer-use-approval-dark.webp"
100 maxHeight="420px"115 maxHeight="420px"
101 variant="no-wallpaper"116 variant="no-wallpaper"
102/>117/>
103 118
104Codex may also ask for permission before taking sensitive or disruptive actions.119ChatGPT may also ask for permission before taking sensitive or disruptive actions.
105 120
106If Codex can't see or control an app, open **System Settings > Privacy &121If ChatGPT can't see or control an app, open **System Settings > Privacy &
107Security** and check **Screen Recording** and **Accessibility** for the Codex122Security** and check **Screen Recording** and **Accessibility** for **Codex
108app on macOS. On Windows, make sure the target app is visible in the active123Computer Use** on macOS. On Windows, make sure the target app is visible in the
109desktop session.124active desktop session.
110 125
111<ToggleSection title="Configure Windows app policy">126<ToggleSection title="Configure Windows app policy">
112 127
113On Windows, Computer Use stores persistent app decisions in128On Windows, Computer Use stores persistent app decisions in
114`$CODEX_HOME/computer-use/config.toml`. List apps that Computer Use can open129`$CODEX_HOME/config.toml`. List the apps that Computer Use can open without
115without prompting and apps that it must decline:130prompting:
116 131
117```toml132```toml
118[apps]133[computer_use.windows]
119allowed = ["mspaint.exe"]134always_allowed_app_ids = ["mspaint.exe"]
120denied = ["calc.exe"]
121```135```
122 136
123Use the app identifier that Windows Computer Use reports, such as an executable137Use the app identifier that Windows Computer Use reports, such as an executable
124name for a desktop app or an app user model ID for a packaged app. Denied apps138name for a desktop app or an app user model ID for a packaged app. ChatGPT
125take precedence over allowed apps. Codex prompts for apps that don't appear in139prompts for apps that aren't in the list. To revoke a saved decision, remove
126either list.140the app from **Settings > Computer Use > Always allow**.
127 141
128This file stores local Computer Use decisions. It's separate from the142This table stores local Computer Use decisions. It's separate from the
129admin-enforced `requirements.toml`, where administrators can disable Computer143admin-enforced `requirements.toml`, where administrators can disable Computer
130Use with `[features].computer_use = false`.144Use with `[features].computer_use = false`. Older
145`$CODEX_HOME/computer-use/config.toml` allow-list entries are migrated into the
146current setting; its `denied` list isn't part of the current policy schema.
131 147
132</ToggleSection>148</ToggleSection>
133 149
134## Locked use150## Locked use
135 151
136Locked use is for macOS. On Windows, computer use works in the foreground.152Locked use is for macOS. On Windows, Computer Use works in the foreground.
137 153
138Locked computer use lets Codex use Computer Use after your Mac locks, but only154Locked use lets ChatGPT use Computer Use after your Mac locks, but only after
139after you enable it. Use it when a Codex task needs to use desktop apps from a155you enable it. Use it when a ChatGPT task needs to use desktop apps from a
140connected device after the Mac locks.156connected device after the Mac locks.
141 157
142When you enable locked computer use, Codex installs an Apple158When you enable locked use, ChatGPT installs an Apple
143[authorization plug-in](https://developer.apple.com/documentation/security/authorization-plug-ins)159[authorization plug-in](https://developer.apple.com/documentation/security/authorization-plug-ins)
144that participates in the macOS unlock flow.160that participates in the macOS unlock flow.
145 161
147path for your Mac, and it doesn't let other apps or local processes unlock the163path for your Mac, and it doesn't let other apps or local processes unlock the
148computer.164computer.
149 165
150To use locked computer use:166To use locked use:
151 167
1521. Open **Codex settings > Computer Use**.1681. Open **Settings > Computer Use** in the app.
1532. Enable locked computer use.1692. Enable locked use.
1543. Start a task that uses computer use from a connected device after your Mac's1703. Start a task that uses Computer Use from a connected device after your Mac's
155 screen has locked.171 screen has locked.
156 172
157When a Codex task accesses an app via Computer Use after your Mac locks, Codex173When a ChatGPT task accesses an app via Computer Use after your Mac locks, ChatGPT
158temporarily unlocks the Mac while blocking local use and preserving the locked174temporarily unlocks the Mac while blocking local use and preserving the locked
159screen protections. Before unlocking, Codex checks whether the unlock attempt is175screen protections. Before unlocking, ChatGPT checks whether the unlock attempt is
160for an active, trusted computer use turn. Outside that short-lived window, Codex176for an active, trusted Computer Use turn. Outside that short-lived window, ChatGPT
161denies the unlock and asks you to unlock manually if needed.177denies the unlock and asks you to unlock manually if needed.
162 178
163Locked use includes safeguards:179Locked use includes safeguards:
164 180
165- The authorization window is short-lived and scoped to the current unlock181- The authorization window is short-lived and scoped to the current unlock
166 attempt.182 attempt.
167- Automatic unlock is available only to Codex during active computer use turns.183- Automatic unlock is available only to ChatGPT during active Computer Use turns.
168- Codex covers every display while the desktop is temporarily unlocked.184- ChatGPT covers every display while the desktop is temporarily unlocked.
169- If Codex detects local keyboard or pointer input, it relocks the Mac and185- If ChatGPT detects local keyboard or pointer input, it relocks the Mac and
170 pauses automatic unlock until you unlock it manually.186 pauses automatic unlock until you unlock it manually.
171 187
172## Safety guidance188## Safety guidance
173 189
174With computer use, Codex can view screen content, take screenshots, and interact190With Computer Use, ChatGPT can view screen content, take screenshots, and interact
175with windows, menus, keyboard input, and clipboard state in the target app.191with windows, menus, keyboard input, and clipboard state in the target app.
176Treat visible app content, browser pages, screenshots, and files opened in the192Treat visible app content, browser pages, screenshots, and files opened in the
177target app as context Codex may process while the task runs.193target app as context ChatGPT may process while the task runs.
178 194
179Keep tasks narrow and stay present for sensitive flows:195Keep tasks narrow and stay present for sensitive flows:
180 196
181- Give Codex one clear target app or flow at a time.197- Give ChatGPT one clear target app or flow at a time.
182- You can stop the task or take over your computer at any time.198- You can stop the task or take over your computer at any time.
183- Keep sensitive apps closed unless they're required for the task.199- Keep sensitive apps closed unless they're required for the task.
184- On Windows, expect Codex to take over foreground input while it works; use a200- On Windows, expect ChatGPT to take over foreground input while it works; use a
185 secondary device, a VM, or stop the task before using that desktop yourself.201 secondary device, a VM, or stop the task before using that desktop yourself.
186- Avoid tasks that require secrets unless you're present and can approve each202- Avoid tasks that require secrets unless you're present and can approve each
187 step.203 step.
188- Review app permission prompts before allowing Codex to use an app.204- Review app permission prompts before allowing ChatGPT to use an app.
189- Use **Always allow** only for apps you trust Codex to use automatically in205- Use **Always allow** only for apps you trust ChatGPT to use automatically in
190 future tasks.206 future tasks.
191- Stay present for account, security, privacy, network, payment, or207- Stay present for account, security, privacy, network, payment, or
192 credential-related settings.208 credential-related settings.
193- Cancel the task if Codex starts interacting with the wrong window.209- Cancel the task if ChatGPT starts interacting with the wrong window.
194 210
195If Codex uses your browser, it can interact with pages where you're already211If ChatGPT uses your browser, it can interact with pages where you're already
196signed in. Review website actions as if you were taking them yourself: web pages212signed in. Review website actions as if you were taking them yourself: web pages
197can contain malicious or misleading content, and sites may treat approved clicks,213can contain malicious or misleading content, and sites may treat approved clicks,
198form submissions, and signed-in actions as coming from your account. To keep214form submissions, and signed-in actions as coming from your account. To keep
199using your browser while Codex works, ask Codex to use a different browser.215using your browser while ChatGPT works, ask ChatGPT to use a different browser.
200 216
201The feature can't automate terminal apps or Codex itself, since automating them217The feature can't automate terminal apps or ChatGPT itself, since automating them
202could bypass Codex security policies. It also can't authenticate as an218could bypass ChatGPT security policies. It also can't authenticate as an
203administrator or approve security and privacy permission prompts on your219administrator or approve security and privacy permission prompts on your
204computer.220computer.
205 221
206File edits and shell commands still follow Codex approval and sandbox settings222File edits and shell commands still follow ChatGPT approval and sandbox settings
207where applicable. Changes made through desktop apps may not appear in the review223where applicable. Changes made through desktop apps may not appear in the review
208pane until they're saved to disk and tracked by the project. Your ChatGPT data224pane until they're saved to disk and tracked by the project. Your ChatGPT data
209controls apply to content processed through Codex, including screenshots taken225controls apply to content processed through ChatGPT, including screenshots taken
210by computer use.226by Computer Use.