The Rundown AI / Guides / General / Automate Any Manual Task With Codex
Automate Any Manual Task With Codex

Automate Any Manual Task With Codex

Try Text

The Rundown In this guide, you will learn how to use Codex to handle repetitive, click-heavy work on your computer. Instead of manually archiving files, moving through queues, or clicking the same button over and over, you can give Codex a tightly scoped task, let it operate the interface visually, and supervise the first few actions before scaling up. The key is not raw autonomy. It is giving Codex a controlled environment, a deterministic workflow, and a clear stop condition. Who This Is Useful For Operators and admins  cleaning up repetitive backlogs in web apps Creators and production teams  moving through repetitive media workflows Anyone with a click-heavy process  that does not justify building a custom automation This works best when the task is repetitive, the interface is stable, and the right action is visually obvious. What You Will Build You will build a repeatable workflow for delegating a manual UI task to Codex. In the example flow, Codex archives a batch of videos in Descript by repeating the same sequence on each row: open the row menu click  Archive confirm if prompted repeat for a fixed number of items That same pattern can be reused for many other tasks: clearing approval queues renaming or moving files tagging records in a CRM clicking through repetitive cleanup work in internal tools What You Need Codex access The  Computer Use  plugin enabled macOS Screen Recording and Accessibility permissions granted to Codex A deterministic task with a clear loop A clear stop rule such as "do the next 20 items" Pro tip:  Do not start with a messy, high-risk task. Pick something boring and predictable first. Step 1 Turn On Computer Use Open Codex settings, find  Computer Use , and click  Install  to install the plugin. When macOS prompts you, grant: Screen Recording , so Codex can see the target app Accessibility , so Codex can click, type, and navigate These system permissions are separate from Codex's app approvals. The system permissions let Codex operate apps at all. The app approvals decide which apps Codex is allowed to touch. Step 2 Approve the Specific App You Want Codex to Use When you start the task, Codex asks for permission before it uses an app on your computer. Approve only the app you actually want it to operate. If this is a browser workflow, that might be Chrome. If it is a media cleanup task, it might be Descript. You can choose  Always allow  for trusted apps you want Codex to use in future tasks without asking again, but use that setting carefully. It is better to stay narrow until you trust the workflow. Step 3 Clean Up the Environment Before You Start Before Codex touches anything, reduce the surface area. close sensitive tabs and unrelated apps use a dedicated browser profile if possible keep only the target app or window visible decide the batch size in advance This is the difference between a controlled test and a sloppy demo. When the screen is clean and the task is narrow, Codex has less room to misread the situation. Also remember that while Codex can only act in approved apps, visible content in the target app is still part of the task context while computer use is running. Step 4 Write the Task Prompt Like an SOP This part matters more than people expect. A vague instruction gets vague behavior. A tight operating procedure gets much better results. Your prompt should include: the exact app the exact page or view the exact button or menu label the loop instruction the batch size what Codex should do when it is unsure Here is a solid example: In Descript, archive the next 20 videos in this list. For each row, click the three-dot menu, click Archive, and confirm if prompted. If you cannot find Archive or you are not sure you picked the right row, stop and ask me before doing anything else. That is the pattern to copy. It tells Codex what tool to use, what action to repeat, when to stop, and how to behave when the UI is ambiguous. Step 5 Let Codex Do One Item First Do not launch a giant batch immediately. Have Codex complete one item first. Watch the screen and confirm three things: it is on the right page it chose the right row or target it clicked the right action Once that first action is correct, let it continue through the rest of the batch. This first-item check is the simplest way to catch a misunderstanding before it becomes a mess. Step 6 Scale to a Small Batch Once the first action is verified, let Codex continue through a small batch like 5, 10, or 20 items. That gives you a practical time win without making the session hard to supervise. It also makes troubleshooting easier because you can stop, adjust the prompt, and rerun the next batch if something drifts. This is a better operating model than telling it to clear an entire backlog with no guardrails. Step 7 Re-Orient It When the UI Drifts Sometimes the UI changes, a modal appears, or Codex loses track of where it is. When that happens, do not rewrite the whole task. Re-orient it. Useful corrections look like this: "You are on the Projects page. Go back to the Videos list." "The Archive button is on the right side of each row inside the three-dot menu." "Stop after the next 5 items, then wait for me." That style works because it restores context without adding noise. If the workflow is still unstable, reduce the batch size and tighten the prompt before you continue. Going Further Once one manual workflow works, turn it into a repeatable operating pattern. Good next candidates: repetitive triage work admin cleanup inside internal tools asset management and file organization batch uploads routine approval or tagging workflows The broader lesson is simple: if a task is visually obvious, repetitive, and bounded, Codex can often handle it without you needing to build a full automation stack first. For local web apps you are building yourself, use Codex's in-app browser first. Reach for Computer Use when the job depends on a live desktop app or a browser UI Codex needs to operate visually. Start with one annoying manual task you already know well. Get one clean run. Then formalize the prompt and reuse it the next time the same work shows up.

Save 15% on Thoughtly by joining The Runway University

Through our vast network of over 100 partnerships with major AI companies, we also offer University members free access or major discounts to the many popular AI tools along with AI certified courses, daily guides on AI tools and many more.

Tools

No items found.

AI training for the future of work.

Get access to all our AI certificate courses, hundreds of real-world AI use cases, live expert-led workshops, an exclusive network of AI early adopters, and more.

General

Business Operations

Coding