ReaperEyes

[inthepipeline]

Is anyone using PluralEyes?
it is a program which can sync audio and video tracks.
In fact, it has all the potential to do this:
http://forum.cockos.com/showpost.php...07&postcount=1
and more ....

It saves hours of tedious work by analysing items waveforms and then aligning them on the timeline. It's a very useful tool designed for those who use more than one camera and maybe several audio recorders with no timecode facility.

I know many Reaper users are involved in film and video.

It strikes me that Reaper is already more than half way to being able to provide similar functionality, but it could probably do more than PluralEyes.
It can already play and render many formats of video.
It can already detect the same transients in similar waveforms and it can already add markers.

If Reaper could detect the transients on a number of selected tracks and then find the corresponding time differences between markers, it could use the data to move the items to a position in which the maximum number of markers line up, using one item as a guide for the final position of the others. It's fairly improbable that (some number,say three? maybe more) markers would appear with the same time interval between them unless each occurence of that time difference should be in the same position on the timeline.

I don't know if that's how PluralEyes works, but I've been playing with 'similar' audio files from different devices, recorded at the same time. I find that the number of detected transient points which coincide across the audio tracks is far greater than I thought, despite the recorders often being a long way apart on-set and picking up all sorts of completely different sounds from closer sources.

I'm sure that if Reaper did this, it would do it very, very well.

What would be the practical uses in musical terms?
Well, if it was clever enough to relax its accuracy by a varying degrees (something it would probably need to do to function) it could be used to tighten the timing of audio tracks automatically.
I think that's quite exciting.


Interesting idea?

[Jae.Thomas]

I use plural eyes and it's really great. However, I am not sure if Reaper is going in the direction of being a video editor, so I'm not sure how worth it it would be...

[inthepipeline]

Using it to align audio to video is just one possibility though.

Suppose you wanted to save loads of time improving the tightness of manualy played audio across tracks, this might be the way to do it.
For example, if the markers applied were strech markers with pitch preserved you could line up guitar tracks with a snare, or if they were split markers you could line up snare with hi-hat. That sort of thing.
I think the possibilities are beyond what PluralEyes does because of the features Reaper already has.

[inthepipeline]

I've expanded on how I think this should/might work.
Here:
http://forum.cockos.com/showthread.php?t=151639

[PelF]

+1000 This would be amazing!

[mschnell]

Without taking a look at "eyes":

The only thing with Video I ever did - and of course in Reaper - was replacing the Audio of a Video by a decent live audio recording taken at the same time with the video.

Being able to automate the sync between the Video Audio track and the new Audio IMHO would be a great feature not making Reaper more of a Video editor as it already is.

-Michael

[mpl]

https://forum.cockos.com/showthread.php?t=179544

Align takes is closer thing which can do this at the moment. Not sure it works directly with audio data from video though.

[mschnell]

Yep.

This does seem to be usable for this purpose.
Many thanks for providing it !
-Michael