Watch this: Adobe shows how OpenAI’s Sora will change Premiere Pro and video editing forever

[Pelican Press 0]

Watch this:

This is the hidden content, please

• Sign In
• or
• Sign Up

shows how OpenAI’s Sora will change Premiere Pro and video editing forever

OpenAI’s Sora gave us a glimpse earlier this year of how generative AI is going to change video editing – and now

This is the hidden content, please

• Sign In
• or
• Sign Up

has shown off how that’s going to play out by previewing of some fascinating new Premiere Pro tools.

The new AI-powered features, powered by

This is the hidden content, please

• Sign In
• or
• Sign Up

Firefly, effectively bring the kinds of tricks we’ve seen from

This is the hidden content, please

• Sign In
• or
• Sign Up

’s photo-focused Magic Editor – erasing unwanted objects, adding objects and extending scenes – to video. And while it isn’t the first piece of software to do that, seeing these tools in an industry standard app that’s used by professionals is significant.

For a glimpse of what’s coming “this year” to Premiere Pro and other video editing apps, check out the video below. In a new Generative panel, there’s a new ‘add object’ option that lets you type in an object you want to add to the scene. This appears to be for static objects, rather than things like a galloping horse, but it looks handy for b-roll and backgrounds.

Arguably even more helpful is ‘object removal’, which uses Firefly’s AI-based smart masking to help you quickly select an object to remove then make it vanish with a click. Alternatively, you can just combine the two tools to, for example, swap the watch that someone’s wearing for a non-branded alternative.

One of the most powerful new AI-powered features in photo editing is extending backgrounds – called Generative Fill in Photoshop – and Premiere Pro will soon have a similar feature for video. Rather than extending the frame’s size, Generative Extend will let you add frames to a video to help you, for example, pause on your character’s face for a little longer. 

While

This is the hidden content, please

• Sign In
• or
• Sign Up

hasn’t given these tools a firm release date, only revealing that they’re coming “later this year”, it certainly looks like they’ll change Premiere Pro workflows in a several major ways. But the ******* AI video change could be yet to come… 

Will

This is the hidden content, please

• Sign In
• or
• Sign Up

really plug into OpenAI’s Sora?

(Image credit:

This is the hidden content, please

• Sign In
• or
• Sign Up

)

The biggest Premiere Pro announcement, and also the most nebulous one, was

This is the hidden content, please

• Sign In
• or
• Sign Up

’s preview of third-party models for the editing app. In short,

This is the hidden content, please

• Sign In
• or
• Sign Up

is planning to let you plug generative AI video tools including OpenAI’s Sora, Runway and Pika Labs into Premiere Pro to sprinkle your videos with their effects.

Get the hottest deals available in your inbox plus news, reviews, opinion, analysis and more from the TechRadar team.

In theory, that sounds great.

This is the hidden content, please

• Sign In
• or
• Sign Up

showed an example of OpenAI’s Sora generating b-roll with a text-to-video prompt, and Pika powering Generative Extend. But these “early examples” of

This is the hidden content, please

• Sign In
• or
• Sign Up

’s “research exploration” with its “friends” from the likes of OpenAI are still clouded in uncertainty.

Firstly,

This is the hidden content, please

• Sign In
• or
• Sign Up

hasn’t committed to launching the third-party plug-ins in the same way as its own Firefly-powered tools. That shows it’s really only testing the waters with this part of the Premiere Pro preview. Also, the integration sits a little uneasily with

This is the hidden content, please

• Sign In
• or
• Sign Up

’s current stance on generative AI tools.

(Image credit:

This is the hidden content, please

• Sign In
• or
• Sign Up

)

This is the hidden content, please

• Sign In
• or
• Sign Up

has sought to set itself apart from the likes of Midjourney and Stable Diffusion by highlighting that

This is the hidden content, please

• Sign In
• or
• Sign Up

Firefly is only trained on

This is the hidden content, please

• Sign In
• or
• Sign Up

Stock image library, which is apparently free of commercial, branded and trademark imagery. “We’re using hundreds of millions of assets, all trained and moderated to have no IP,”

This is the hidden content, please

• Sign In
• or
• Sign Up

’s VP of Generative AI, Alexandru Costin, told us earlier this year.

Yet a new

This is the hidden content, please

• Sign In
• or
• Sign Up

claims that Firefly was partially trained on images generated by Midjourney (with

This is the hidden content, please

• Sign In
• or
• Sign Up

suggesting that could account for 5% of Firefly’s training data). And these previews of new alliances with generative video AI models, which are similarly opaque when it comes to their training data, again sits uneasily with

This is the hidden content, please

• Sign In
• or
• Sign Up

’s stance.

This is the hidden content, please

• Sign In
• or
• Sign Up

’s potential get-out here is Content Credentials, a kind of nutrition label that’s also coming to Premiere Pro and will add watermarks to clarify when AI was used in a video and with which model. Whether or not this is enough for

This is the hidden content, please

• Sign In
• or
• Sign Up

to balance making a commercially-friendly pro video editor with keeping up in the AI race ******** to be seen.

You might also like

This is the hidden content, please

• Sign In
• or
• Sign Up

#Watch #

This is the hidden content, please

• Sign In
• or
• Sign Up

#shows #OpenAIs #Sora #change #Premiere #Pro #video #editing

This is the hidden content, please

• Sign In
• or
• Sign Up