OpenAI added help for a number of note-taking and coding apps inside the ChatGPT app for macOS on Thursday. The AI agency described this function as agentic and highlighted that the chatbot will be capable of learn on-screen info within the supported apps and assist customers with queries. This function is at present obtainable to solely the paid subscribers of the AI platform and customers can use the Superior Voice Mode whereas working with these apps. OpenAI said that Home windows customers and people on the free tier of the app will get this function subsequent yr.
ChatGPT Now Works With Some Third-Occasion Apps
The brand new function was introduced on day 11 of OpenAI’s 12-day delivery schedule. This new agentic functionality, which permits the chatbot to learn info in a number of note-taking and coding apps is being added to the macOS app of ChatGPT, the corporate highlighted in an X (previously generally known as Twitter) post.
Kevin Weil, the Chief Product Officer at OpenAI additional revealed that ChatGPT can work with roughly 30 macOS apps. The total listing contains Apple Notes, BBEdit, MatLab, Nova, Script Editor, TextMate, VSCode Insiders, VSCodium, Cursor, WindSurf, Android Studio, AppCode, CLion, DataGrip, GoLand, IntelliJ IDEA, PHPStorm, PyCharm, RubyMine, RustRover, WebStorm, Prompts, Warp, Notion, and Quip.
With this function, customers can open a supported app and go to any display screen or content material. They will then use the shortcut Choice + Area to open a small text-field view of the app. The chatbot can see what the consumer sees within the app, as soon as activated. Then, the consumer can both use textual content prompts or the Superior Voice Mode to ask queries, and ChatGPT can reply to them. Customers may spotlight a particular a part of textual content or code after which use pure instructions resembling “tips on how to make this higher” and the AI will perceive the context.
Whereas the corporate calls it an agentic function, it’s technically extra of a vision-based function. The agentic perform is required solely when gaining permission to entry these apps. Nevertheless, ChatGPT will be unable to work together with these apps and can’t carry out duties resembling writing textual content or code or altering present info.
For privateness, customers will be capable of management when and which apps will be accessed by ChatGPT. Moreover, OpenAI said that customers can have the identical stage of management over this knowledge as they’d over the rest of their dialog historical past.
This function is at present obtainable to ChatGPT Plus, Professional, Groups, Enterprise, and Edu subscribers. Free customers and people utilizing the Home windows app must wait until the following yr to get this function.