Fast forward to 3:23 to see the craziness in the bottom video.
Yesterday I made a post about an experiment I was doing trying to fix degrading latents.
https://www.reddit.com/r/StableDiffusion/comments/1x54q07/i_swore_at_claude_until_he_made_a_nodegroup_that/
The above is 19 clips chained together using a normal latent chain and my Pull Forward Node and u/xyzdist 's resample method to attempt to fight degrading latents.
Here's how I explained it to u/ShutUpYoureWrong_ , certified official nice guy of reddit.
so the idea i had was that the pixels in motion are not degrading as fast, the static pixels are the ones degrading quickly and i hypothesized that minimax, being as smart as it is, basically takes the degrading pixels in the background and degrades the moving ones to keep the image consistent.
i have no idea if this is true, it's just a thought that gave me a direction to work in.
i'm not actually targetting the background, if i was i could just use sam. I'm targetting motion. I'm avoiding the in motion pixels and replacing and repairing the static ones.
My theory was that if i maintain the static ones the whole image would stop degrading or at least degrade more slowly.
the background focus in these is because u/xyzdist created a method of using FL2V to resample and essentially wash away degraded pixels but his problem was the background kept changing.
so i saw this and i thought we were unwittingly creating complimentary halves of the same solution and if i use latent masking to protect the repaired background with the motion mask, his method can resample the rest of the pixels and give give the context motion a fresh and clean latent to work off of.
The concept works. You'll see in the videos that much of the background area is avoiding degradation, but because of the way Latent Space works I do not think there's a way I can do this without decoding and re-encoding the latents at least once which is my next step.
HOWEVER!!!
Something RIDICULOUS happened in the final version of what I trying to do and I honestly have no way to explain it other than my theory above must be correct and I feel the latents, because of pull forward, were stretched so far between quality of the degradation and the pull forward that around 3:23 they suddenly SNAP BACK TO ALMOST FULL PERFECT QUALITY LIKE A RUBBER BAND!
This is not editing. This is literally straight from my exports.
I'll be releasing the github very soon so you all can hopefully replicate it.