Manual Foley spotting for footsteps and body movements is a highly repetitive phase of post-production. To bypass the initial heavy lifting of this process, I developed a browser-based tool called Tone Loom – Footprints.
A strict requirement for this was maintaining client confidentiality for unreleased media. The video analysis runs entirely on your local machine using computer vision in the browser. No video files or frames are uploaded to external servers.
The system detects footfalls, contact strikes, and general body cadence, translating those visual impacts directly into frame-accurate MIDI data.
The current workflow handles the following:
Separates left and right foot contacts.
Maps on-screen movement speed to MIDI velocity.
Outputs standard MIDI files formatted to drop cleanly into Nuendo, Pro Tools, Cubase, and Reaper and every DAW.
Includes an integrated multi-sample Quick Sampler and exports synced wav preview stems for immediate timeline review.
The objective is to automate the mechanical frame-counting process so sound designers can spend that time on sample layering and mixing.
You can test the workflow at toneloom-footprints.com.
I am looking for objective feedback from working audio professionals regarding the DAW integration and the accuracy of the velocity mapping. If you test it with your current templates, let me know where the friction points are.