Old 04-03-2016, 11:20 AM   #1
TumbleAndYaw
Human being with feelings
 
Join Date: Mar 2016
Posts: 9
Default 360º*video in Reaper?

Hi,

To make this amazing thing that is Reaper even more amazing, would be the addition of 360º video playback. This is a new and upcoming format that is expected to get a lot of traction over the coming years...

Could that be done? It would be similar playback functionality like this app, but now right in the Reaper timeline:

http://www.kolor.com/kolor-eyes/download/

Maybe Cockos and Kolor can partner on this...
TumbleAndYaw is offline   Reply With Quote
Old 04-04-2016, 07:46 AM   #2
Justin
Administrator
 
Justin's Avatar
 
Join Date: Jan 2005
Location: NYC
Posts: 12,316
Default

Could probably write a video processor to deform the video as desired....
Justin is offline   Reply With Quote
Old 04-05-2016, 11:51 PM   #3
TumbleAndYaw
Human being with feelings
 
Join Date: Mar 2016
Posts: 9
Default

Quote:
Originally Posted by Justin View Post
Could probably write a video processor to deform the video as desired....
Thanks Justin. That would be such a help for many of us spatial audio engineers, that currently have no reliable way of locking audio and picture.

Not sure if this helps, but here is some Ffmpeg code, for the cubemap projection that Facebook uses, a very efficient way of projecting:

https://github.com/facebook/transform

Albert
TumbleAndYaw is offline   Reply With Quote
Old 04-06-2016, 01:55 PM   #4
plush2
Human being with feelings
 
Join Date: May 2006
Location: Saskatoon, Canada
Posts: 1,826
Default

This would be a great addition. Reaper is so ideally suited to Ambisonic and spatial mixing techniques already.
__________________
mymusic - http://music.darylpierce.com
mywork - http://production.darylpierce.com
plush2 is offline   Reply With Quote
Old 06-15-2016, 10:00 PM   #5
plush2
Human being with feelings
 
Join Date: May 2006
Location: Saskatoon, Canada
Posts: 1,826
Default

So I think I've found a script to help with this at the Google mathmap project. Now, among other things I need to know what sort of transform I need to use to create the desired effect from this math.

I've tried with gfx_blit and I can get panning to work but that's all, no bending or windowing of the image. I know I'm way out of my depth with all this but I'm wanting to see it done.

Code:
//@param1:FoV 'view' 150 15 320 150 1
//@param2:eye 'eye' 1 0 1.5 0.5 0.01
//@param3:pan 'pan' 0 -180 180 0.5 1
//@param4:vsh 'shape' 0 -1 1 0 0.01
img1 = 0;
img2 = input_ismaster();
input_info(src,W,H);
pi = 3.14159265;
//angular scale factors 
Sppr = W / (2*pi); //source pixels/radian 
d = eye + 1; 
wfov = pi * min( FoV, 160 * d ) / 180; //radians 
Drpp = 2*d*tan(wfov/(2*d)) / W; 
W > 0 ? (
  gfx_a = W;
  //destination coordinates in radians 
  xr = x * Drpp; yr = (y - Y * vsh) * Drpp; 
  //project from dest to source 
  azi = d * atan2( xr, d); 
  alt = atan2( yr * (eye + cos(azi)), d ); 
  //source coordinates in pixels 
  sx = Sppr*azi; sy = Sppr*alt; 
  //pan & interpolate 
  sx = sx + W*pan/360;
  gfx_blit(img1, paspect, sx|0, sy|0, W, H);
  );
//if sx > X then sx = sx - W end; 
//if sx < -X then sx = sx + W end; 
//in(xy:[sx, sy])
The basic desire is to have Panini type viewer for equirectangular panoramic video.
__________________
mymusic - http://music.darylpierce.com
mywork - http://production.darylpierce.com

Last edited by plush2; 06-16-2016 at 01:40 PM.
plush2 is offline   Reply With Quote
Old 06-16-2016, 11:40 AM   #6
RobinGShore
Human being with feelings
 
Join Date: May 2013
Location: New York
Posts: 368
Default

I'd love to see this happen. We've been working on a lot of VR/360 video content lately at my studio. Right now we're using SpookSync3D to sync playback between Reaper and Kolor Eyes, but to have 360 videos working natively in Reaper would be really awesome.
__________________
www.silversound.us
RobinGShore is offline   Reply With Quote
Old 06-20-2016, 06:56 AM   #7
Justin
Administrator
 
Justin's Avatar
 
Join Date: Jan 2005
Location: NYC
Posts: 12,316
Default

Quote:
Originally Posted by plush2 View Post
So I think I've found a script to help with this at the Google mathmap project. Now, among other things I need to know what sort of transform I need to use to create the desired effect from this math.

I've tried with gfx_blit and I can get panning to work but that's all, no bending or windowing of the image. I know I'm way out of my depth with all this but I'm wanting to see it done.

Code:
//@param1:FoV 'view' 150 15 320 150 1
//@param2:eye 'eye' 1 0 1.5 0.5 0.01
//@param3:pan 'pan' 0 -180 180 0.5 1
//@param4:vsh 'shape' 0 -1 1 0 0.01
img1 = 0;
img2 = input_ismaster();
input_info(src,W,H);
pi = 3.14159265;
//angular scale factors 
Sppr = W / (2*pi); //source pixels/radian 
d = eye + 1; 
wfov = pi * min( FoV, 160 * d ) / 180; //radians 
Drpp = 2*d*tan(wfov/(2*d)) / W; 
W > 0 ? (
  gfx_a = W;
  //destination coordinates in radians 
  xr = x * Drpp; yr = (y - Y * vsh) * Drpp; 
  //project from dest to source 
  azi = d * atan2( xr, d); 
  alt = atan2( yr * (eye + cos(azi)), d ); 
  //source coordinates in pixels 
  sx = Sppr*azi; sy = Sppr*alt; 
  //pan & interpolate 
  sx = sx + W*pan/360;
  gfx_blit(img1, paspect, sx|0, sy|0, W, H);
  );
//if sx > X then sx = sx - W end; 
//if sx < -X then sx = sx + W end; 
//in(xy:[sx, sy])
The basic desire is to have Panini type viewer for equirectangular panoramic video.
Have a video to test with? I think you could use gfx_xformblit() or whatever it is called to undeform it...
Justin is offline   Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT -7. The time now is 06:45 PM.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.