Appshots

Appshots is a tool that lets ChatGPT Work grab a snapshot-like read of your screen at that moment, so it can tell what's on and what state it's in. It's a bit like pointing at your screen and telling a coworker, "look, it's like this right now," when handing off a task.

Thanks to this tool, ChatGPT Work can take in the screen context from a PC app like Spotify or a web service open in Chrome, such as Google Calendar, and also gain the ability to keep working on top of it. But for actions that are hard to undo, like submitting a form or saving an event, the user is still always required to review a draft themselves, even after Appshots has shared the context.

In a demo where ChatGPT Work operates Spotify and pulls together Chrome and Google Calendar to prepare a leave request, the article explains that a tool called Appshots shares the current screen's context with ChatGPT and hands over access to it. A common misunderstanding is that Appshots isn't a simple screenshot feature that just captures and saves the screen — it's an integration mechanism that lets ChatGPT Work read the screen state in real time and gain the authority to act on it.