During a livestream on Tuesday, OpenAI CEO Sam Altman announced the first major upgrade to ChatGPTโs image-generation capabilities in over a year.
ChatGPT can now leverage the companyโs GPT-4o model to natively create and modify images and photos. GPT-4o has long underpinned the AI-powered chatbot platform, but until now, the model has been able to generate and edit only text โ not images.
Altman said GPT-4o native image generation is live today in ChatGPT and Sora, OpenAIโs AI video-generation product, for subscribers to the companyโs $200-a-month Pro plan. OpenAI says the feature is rolling out soon to Plus and free users of ChatGPT, as well as developers using the companyโs API service.
GPT-4o with image output โthinksโ a bit longer than the image-generation model it effectively replaces, DALL-E 3, to make what OpenAI describes as more accurate and detailed images. GPT-4o can edit existing images, including images with people in them โ transforming them or โinpaintingโ details like foreground and background objects.
To power the new image feature, OpenAI told the Wall Street Journal it trained GPT-4o on โpublicly available data,โ as well as proprietary data from its partnerships with companies like Shutterstock.
Many generative AI vendors see training data as a competitive advantage, so they keep it and any information related to it close to the chest. But training data details are also a potential source of IP-related lawsuits, another disincentive for companies to reveal much.ย
โWeโre respecting of the artistsโ rights in terms of how we do the output, and we have policies in place that prevent us from generating images that directly mimic any living artistsโ work,โ said Brad Lightcap, OpenAIโs chief operating officer, in a statement to the Journal.
OpenAI offers an opt-out form that allows creators to request that their works be removed from its training datasets. The company also says that it respects requests to disallow its web-scraping bots from collecting training data, including images, from websites.
ChatGPTโs upgraded image-generation feature follows on the heels of Googleโs experimental native image output for Gemini 2.0 Flash, one of the companyโs flagship models. The powerful feature went viral on social media โ but not necessarily for the best reasons. Gemini 2.0 Flashโs image component turned out to have few guardrails, allowing people to remove watermarks and create images depicting copyrighted characters.
This article was update at 12pm PT to include OpenAIโs statement to the Wall Street Journal around GPT-4oโs training data.
