Skip to content

Interpolated Frames turn out Pixelated #29

@Zotikus1001

Description

@Zotikus1001

Hello again.
I finally had some time, and managed to get the anime dupe only interpolation working. The thing I spoke on #4 (You can see on my fork) It can use some improvements, but it's working :)

So now I'm left with solving the Pixelation that happens on 90% of interpolated frames. Very noticeable on fast moving scenes.

I did some testing with DAIN original repo today, and the pixelation doesn't happen (DainApp also doesnt happen). There are artifacts, ofc, but no pixelation.
So I'm inclined to believe something is wrong with your DAIN interpolation code.
I took a look, but I'm afraid it's too much for my noob self. :)

I used the original DAIN with the latest colab file they provided.

Here are some examples of what I'm talking about:

Original DAIN: (Notice the artifacts)
image

And this is using MVIMP: (Notice how pixelated everything looks. Also the weapon fire effect is a green blue color for some strange reason)
image

Here's another example from another video:
image

Here's a video where you can actually tell without going frame by frame: https://www.youtube.com/watch?v=Qa54A1-FOWY
*You can use , and . on youtube to go frame by frame.

And heres a video using the original DAIN: https://www.youtube.com/watch?v=sN1VA-gg7yM (No pixelation)

I understand artifacts will always happen. But Artifacts + Pixelation makes it much worse.
I'd love to solve this problem so I can start interpolating some anime. The pixelation is even worse on anime.

*The pixelation is happening whether I use High Resolution splitting or not. So that's not it.

Any help would be greatly appreciated.
Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions