|
03-24-2020, 04:01 PM | #1 |
Human being with feelings
Join Date: Feb 2020
Location: San Diego, CA
Posts: 19
|
How to Sync Spatial Audio & 360 Video — Includes Reaper Project Download
We created a tutorial over on the Voyage Audio blog to help people sync Spatial Audio to 360 Video using Facebook 360 Spatial Workstation. There is also a downloadable Reaper Session to help with understanding the workflow. Let me know if we missed something and hope it can help some people out!
https://voyage.audio/how-to-sync-spa...-360-vr-video/
__________________
Download The Free Spatial Mic Reaper Session: https://voyage.audio/listen-to-spatial-mic/ |
10-15-2020, 09:12 AM | #2 |
Human being with feelings
Join Date: Nov 2009
Location: UK
Posts: 669
|
Nice tutorial.
I make an XML to Reaper conversion tool. It occurred to me that Final Cut Pro X which has native 360 video support also exports pan, tilt, roll metadata for each clip in it's XML exports. Currently my tool ignores this but it would be possible to convert this metadata into automation in reaper (especially easy if using the ATK as those are JS FX). Would this be useful? |
10-19-2020, 01:40 AM | #3 | |
Human being with feelings
Join Date: Oct 2019
Posts: 2
|
Quote:
Currently it is a complete time waster trying to re position spatial audio again, after the video has been rotated.. The perspective is always changed in the video edit, and all my intricate spatial locking goes to waste. Afterwards i have to automate by eye, ear, and SPL power map.If i am lucky (next to never) I have access to the NLE or the editor tells me what they have done. Then i have idea where to start. Either way it takes ages, and there is no automated process to do this in any DAW/NLE. I searched believe me 🙃 You would get loads of the spatial audio community on board with this function alone! If this could be done for Premier too, you would get them all! 😉 I use higher order plugins, not the atk, but any automation can be reassigned in reaper anyway. Even easier if its labelled... This is even useful for vbap/dbap plugs that allow rotation too.. Which i sometimes use for discreet channel based installations. Quite excited at the prospect! Cheers |
|
10-19-2020, 04:15 AM | #4 | |
Human being with feelings
Join Date: Nov 2009
Location: UK
Posts: 669
|
Quote:
Worth considering that the 360 metadata belongs to the video item, not tracks or audio items. So how best to transfer it? Vordio already allows you to include video clips as empty items (it can be useful to see where the picture cuts are for sound design). So I could put a JSFX on the empty video item to hold the automation. How easy is it to move item FX automation to another item or track? Or else could dump the metadata into item notes and have a script transfer it. Vordio already dumps useful metadata such as scene/take into item notes. Another possibility would be to dump ADM axml (audio definition model) metadata. There is now a free reaper extension for importing ADM for spatial audio. https://www.bbc.co.uk/rd/blog/2020-1...software-tools https://www.youtube.com/watch?v=u7P5...ture=emb_title What will be the best workflow? Last edited by mrlimbic; 10-19-2020 at 04:23 AM. |
|
10-19-2020, 05:30 AM | #5 |
Human being with feelings
Join Date: Nov 2009
Location: UK
Posts: 669
|
Just checked Premiere XML. It doesn't include the VR rotate filter metadata in the XML.
"Translation issue: Sequence <wells ambi weds> at , video track 1: Effect <VR Rotate Sphere> on Clip <wells ambi weds.mov> not translated." However it may be possible to script Premiere to export axml for VR clips which could then be loaded in reaper using the EAR Production Suite. https://premiere-scripting-guide.rea...nentparam.html |
10-19-2020, 10:09 AM | #6 |
Human being with feelings
Join Date: Nov 2009
Location: UK
Posts: 669
|
OK. I have got something basic working with FCPX.
These time=angle pairs get added to item notes for empty video items. The negative time values are not a bug. My test had out of range keyframes on clips in FCPX. I could filter them out but probably not necessary, especially if they are to be converted to track automation. A script could read these and apply them to plugin automation parameters. Add the the item position to parameter time and you'd have track automation point time. Static rotate (clip with no keyframes) Code:
TILT: 72.2522 PAN: -98.1707 ROLL: -267.598 Code:
TILT: -62.920=14.192, -50.760=14.192, 12.840=-254.793, 29.160=88.8078, 92.360=14.192 PAN: -62.920=-198.393, -50.760=-184.62, 12.840=-182.885, 29.160=-104.839, 92.360=-10.1287 ROLL: -62.920=0.0, -50.760=0.0, 12.840=177.096, 29.160=438.698, 92.360=0.0 Last edited by mrlimbic; 10-19-2020 at 10:15 AM. |
Thread Tools | |
Display Modes | |
|
|