Hello guest, if you like this forum, why don't you register? https://forum.fanres.com/member.php?action=register (December 14, 2021) x


A new era for logo removal and Open Matte?

7 Replies, 1758 Views

Check this out: https://www.youtube.com/watch?v=86QU7_SF16Q
.
.
.
WOW!!!
.
.
Sadly my projects are lost due to an HDD crash... Sad
Fundamental Collection | Vimeo channel | My blog
Maybe it's the skeptic in me but some of that seems too good to be true.

How does it know what's on the right of this shot before it appears like that wooden frame thing?

[Image: MDhyZ5M.jpg]
(This post was last modified: 2020-10-14, 01:01 PM by Hitcher.)
You can do this right now, just not with the same degree of AI interpretation. After Effects borrowed content aware fill from photoshop a year or more ago. I’ve already used it on two open matte projects to remove jump in/jump out logos that lasted for 3 or 4 minutes. The key is to add a lot of key frames and if it doesn’t work the first time, try again. Every time AE’s content aware fills takes a slightly different approach. Not the same thing as this but easy to do now.

https://youtu.be/25ltIoHtiO4
(2020-10-14, 01:00 PM)Hitcher Wrote: Maybe it's the skeptic in me but some of that seems too good to be true.

How does it know what's on the right of this shot before it appears like that wooden frame thing?

I just guess:
it can't predict beforehand, so it must analyze all the shot first; then would be "trivial" to put content on left and right - even if it's not possible to do it perfectly at the beginning of a shot, as there is nothing to "steal" from; for top and bottom without pans is not possible as well.

Still, I guess that with an UAR version with four empty corners should be relatively easy to fill them. I don't know how much time will take, though (time=money, as IIUC it is a cloud solution).
Sadly my projects are lost due to an HDD crash... Sad
Fundamental Collection | Vimeo channel | My blog
(2020-10-14, 06:59 PM)spoRv Wrote:
(2020-10-14, 01:00 PM)Hitcher Wrote: Maybe it's the skeptic in me but some of that seems too good to be true.

How does it know what's on the right of this shot before it appears like that wooden frame thing?

I just guess:
it can't predict beforehand, so it must analyze all the shot first; then would be "trivial" to put content on left and right - even if it's not possible to do it perfectly at the beginning of a shot, as there is nothing to "steal" from; for top and bottom without pans is not possible as well.

Still, I guess that with an UAR version with four empty corners should be relatively easy to fill them. I don't know how much time will take, though (time=money, as IIUC it is a cloud solution).

Yeah, that makes sense. Thanks.
My guess is it works by analyzing first the video to see what can be gotten from that, and to then use inpainting for the rest, with the added difficulty of temporal coherence, which is the big impressive thing about this new one. In the video he compares it to older methods which produce a lot of artifacts. But AI these days is so damn smart it really can create not only something like Content-Aware fill but even logically continue images, it's pretty incredible. That same Youtube-channel made a video about that a few weeks ago.
This AI would probably work well with 3D conversion WRT in-painting, might even be able to generate decent depth maps

Possibly Related Threads…
Thread Author Replies Views Last Post
  A free open alternative to Dolby Atmos and Vision spoRv 2 327 2022-09-24, 07:51 PM
Last Post: spoRv
  disc.blue - a new free open file-based format spoRv 0 318 2022-02-10, 12:25 AM
Last Post: spoRv
  Buffy Promo Logo Design Help! Ruppi007 1 1,384 2019-04-14, 11:30 PM
Last Post: spoRv
  [Help] Automated Scratch Removal Booshman 5 3,280 2018-09-05, 03:04 PM
Last Post: Booshman
  Creating Open Matte from Panning Shots nightstalkerpoet 0 1,412 2018-06-07, 07:47 PM
Last Post: nightstalkerpoet
  3D Open Matte Jonnyxll 10 6,857 2018-03-14, 04:57 PM
Last Post: trondmm
  [Help] How to find out whether a movie was filmed with "Open Matte"? TomArrow 20 12,038 2018-01-27, 08:37 PM
Last Post: Papai2013
  Edge Enhancement Removal Synnove 12 7,392 2017-12-31, 10:19 PM
Last Post: Synnove
  Logo/Station ID Removal PDB 69 58,999 2016-11-29, 02:46 PM
Last Post: spoRv



Users browsing this thread: 1 Guest(s)