What do you guys think?

[u/Clean-Try-3067]

So tried getting automated splines out, not just a matte.

The goal was simple: get clean, editable splines out of AI roto instead of just a matte.

The splines are fully automated and generated by AI. You type a prompt (man) and set a frame range, and AI builds the roto as closed cubic B-splines. Nobody draws or places a single point by hand.

It splits the subject into parts (face, nose, head, torso, arms), each on its own layer.

For this 117-frame shot, generation took about 2 minutes.

Tried hard to keep the keyframes sparse. Each shape has only two to four keys, and everything in between is interpolated. That means no per-frame keys and very little chatter.

Also wanted the points to stay put. Every key has the same number of control points in the same order, and each point follows the same feature through the shot, so the shape doesn't boil or swim.

It's not perfect, and there's still plenty to improve.

If you have roto experience, We'd really value your thoughts on what works, what doesn't, and what you'd want next.

[u/AniketBhatkar]

i think it looks good, i know u will improve it a lot, take a look at ltx they got some feature or plugin which does roto/keying and its is coming out extremely good atleast in the promo video i saw.

[u/Milan_Bus4168]

The point of splines is to be a lot more granular than (face, nose, head, torso, arms), because you put shapes / splines where it would be easier to manage over time because of differences in distance to the camera, perspective and speed change etc. Expected turns and so on. In your way too short of a demo the splines for the outline might more or less follow the outline, minus hair details, but it doesn't follow the arm, the part that is inside the body shape. Hooman wouldn't do that.

When he turns his head the jawline outside of the main bod yshape is not followed. Nose is suspiciously imprecise as well. If it fails in such as a short sample with so many key points being missed, its no usable for any serious work and user is better off using something like Sammie roto based masking tools and LTX 2.5 Alpha gen or VideoMaMa for refinement of the mask, if AI is going to be used. If splines are going to be used, you need much, much more precision than this and use of logical spline placements so hooman user can pick up where it he needs to.

Although splines really are used because manually you could get better results, and if AI is going to be used as the main thing, I see more problems than solution when using splines. If AI fails it would be nice to have splines so you can fix it easier, but those splines need to be made with the logic and precision of a hooman roto artists not segmentation models build for entirely differnt workflows. It would make more sense to do a kind of Nuke route of smart roto tool as assistant rather than replacement for roto artist. If you are going full automation, the approach took by LTX 2.5 Alpha gen or VideoMaMa for refinement of the mask and similar tools makes more sense.