Adobe’s new upscaling tech uses AI to sharpen video

[Pelican Press 0]

This is the hidden content, please

• Sign In
• or
• Sign Up

’s new upscaling tech uses AI to sharpen video

Most new features and experiments

This is the hidden content, please

• Sign In
• or
• Sign Up

has announced recently involve AI, like object addition and removal for Premiere Pro and text-based image generation in Photoshop. Now, the company has unveiled

This is the hidden content, please

• Sign In
• or
• Sign Up

, an experimental AI feature it says can upscale video by eight times without the usual artifacts like flickering or distortion,

This is the hidden content, please

• Sign In
• or
• Sign Up

reported.

VideoGigaGAN beats other Video Super Resolution (VSR) methods because it avoids the usual artifacts and flickering introduced by GAN (General Adversarial Networks), according to

This is the hidden content, please

• Sign In
• or
• Sign Up

. At the same time, it adds sharpness and detail — where most other systems fail to do do both of those things at once.

Of course, the system is making up detail that doesn’t exist out of whole cloth, so this wouldn’t be suitable for things like forensic video enhancement, à la CSI-style ****** shows. But the detail it does add looks impressively real, like skin textures, fine hairs,

This is the hidden content, please

• Sign In
• or
• Sign Up

and more.

The model builds on a large-scale image upsampler called GigaGAN, according to to

This is the hidden content, please

• Sign In
• or
• Sign Up

’s researchers. Previous VSR models have had difficulty generating rich details in results, so

This is the hidden content, please

• Sign In
• or
• Sign Up

married “temporal attention” (reducing artifacts that accumulate over time), feature propagation (adding detail where none exists), anti-aliasing and something called “HF shuttle” (shuttling high-frequency features) to create the final result.

If added to products like Premiere Pro or After Effects, it could allow video producers to make low-resolution shots look a lot better, though using AI too enhance people is a controversial practice. There’s no word yet on whether

This is the hidden content, please

• Sign In
• or
• Sign Up

plans to do this (currently, the clips are short and only play at 12fps) but plenty of companies including NVIDIA,

This is the hidden content, please

• Sign In
• or
• Sign Up

, Blackmagic Design and others are working on AI upscaling technology as well.

This is the hidden content, please

• Sign In
• or
• Sign Up

VideoGigaGAN, news, gear, upscaling,

This is the hidden content, please

• Sign In
• or
• Sign Up

#Adobes #upscaling #tech #sharpen #video

This is the hidden content, please

• Sign In
• or
• Sign Up