You Can Use ChatGPT, Veo 2 and Imagen 3 in Adobe Firefly Now

Adobe is overhauling its Firefly family of AI models. At Adobe Max London, the company announced two new AI image models, Firefly 4 and 4 Ultra and a new canvas board workspace called Firefly Boards. It’s also bringing its video generator out of beta to public release. 

Oh, and the company is partnering with OpenAI and Google to bring its AI models into Firefly. Its content credentials app is in public beta now, free for anyone to use to sign their work and denote generative AI use, not just Adobe subscribers. Adobe can verify your identity because it’s also partnered with LinkedIn.

That’s a lot of news — let’s break it all down.

New Firefly image and video models: What to know

First, Firefly’s new generation of AI image models is here. They come in two flavors, Firefly 4 and 4 Ultra. Firefly 4 is meant to be for when you want to generate visuals quickly and efficiently. It has some improvements over the current model, but the true leaps forward are in 4 Ultra. The most advanced image model from Adobe yet, 4 Ultra creates what Adobe calls “impeccable detail and realism.” Firefly 4 Ultra is better at handling detail-intensive scenes and creating more realistic-looking humans (a notorious challenge for AI). 

The Firefly video model is officially now generally available — not a huge change since anyone could pay to try it out when it was opened to the public in beta in February. The Firefly AI video generator has many advanced controls — you can pick the camera motion and angle, in addition to all the other customization options that are necessary for creating good AI clips. Firefly videos are 5-second-long clips with no sound. You’re able to generate in 540p, 720p and 1080p — lower-resolution videos are generated quicker. You can do text-to-video prompts and add images as style and composition references.

All the new AI models are available now for Adobe users with a Creative Cloud subscription — including the video model, unlike before. If you’re just interested in Firefly AI, you can still nab a cheaper, more limited Firefly standard or pro plan without tacking on additional Adobe programs.

You can use ChatGPT, Veo 2 and Imagen 3 in Firefly now

Firefly AI not your jam? No need to switch to another program. In surprising news, Adobe has partnered with OpenAI, Google, and a few other AI creative companies to bring third-party models into Adobe Firefly. The models available now include ChatGPT’s native image generator, Google’s Imagen 3, Flux 1.1 and Google’s Veo 2 for video. Other models slated for future integration include those from fal.ai, Ideogram, Luma, Pika and Runway.

Typically, when you use an AI model, you have to agree to its privacy and training policies, no matter where you use it. But when you use third-party models through Adobe Firefly, the other companies must agree to abide by Adobe’s AI policy, which forbids the company from training on user content. That means if you want to create images with ChatGPT but not let the company access your data, you can do that through Firefly — even though ChatGPT’s policy might otherwise allow the company to train if you use it through their app or website. 

This is a major win for creators concerned about privacy while using AI, and Adobe hopes it gives its professional creators some peace of mind when using AI products through Firefly. This is also markedly different from Canva’s AI product terms, which say that your data can be shared with third-party companies like OpenAI, which “may not provide the same level of protection.” You can check out Adobe’s full privacy policy and generative AI guidelines for more info.

Moodboard with Firefly

Rounding out the Firefly news is a new project called Firefly Boards. It’s a kind of infinite digital canvas workspace. You can use it to create moodboards, storyboards or generally any kind of creative planning. One of the unique features in Boards is called Remix, which lets you select different images to combine. Firefly will analyze the photos, automatically write a prompt, and generate image variations that combine the elements and styles of the original images.

And if you’re a true Firefly fan, there’s one last piece of news: Adobe confirmed it is working on a true mobile app for Firefly. There’s no set release date yet, but it promises to include new optimizations and features different from the current web app.

For more, check out Premiere Pro’s first generative AI feature and what’s inside the long-awaited Photoshop iPhone app.