Web Interface: Rythmoband for ADR and Voice Dubbing within REAPER

[X-Raym]

Hi !


Following some of my first thread discussion, here finally a smooth and easy to use Rythmoband solution for voice dubbing in REAPER!


The trick is to use Web Interface, which allows way more frame per seconds than ReaScript GUI (due to limitation in REAPER defer rate and defer rate stability).
It also is able to overcome some video processor limit regarding some limited variable access.



Here is the result (activate english subtitles if needed):






Detailed article:

• ReaScripts Pack: Rythmoband for ADR and Dubbing within REAPER

Still working on it adding and optimizing few things here and there.
The plan isn't to make it as fully featured as a dedicated rythmoband software, but to bring an affordable and easy to use solution for people wanting to try voice dubbing.


I would love to hear your feedback on this!



Cheers! 🎤

[VES DROP]

Hi X-Raym!

Your tool seems to be as intuitive as srt editing, it's awesome!
It's even possible to be precise at a syllable level.
When we look at the price of others rythmoband softwares, we have to thank you to bring this affordable solution to reaper.

Is it possible to adjust the appearance of the rythmoband (font, color of the background, the box color of the text turning black when reading etc...) ?

Thanks for your response !

[X-Raym]

@VES DROP
Hi, thanks for your feedback! 🤘

Originally Posted by VES DROP

When we look at the price of others rythmoband softwares, we have to thank you to bring this affordable solution to reaper.

This was definitely a strong motivation to make something possible. I wish I could share it free but reascript custom dev tasks is quite low these days so I need to find extra ways, we'll see if the price is right... No sell right (It would need to be shared into dubbing communities but I'm a outsider and not sure they follow reaper stuff so not sure the script will find its public &#128064

Originally Posted by VES DROP

Is it possible to adjust the appearance of the rythmoband (font, color of the background, the box color of the text turning black when reading etc...) ?

For now it has two "themes"

• dark background, text background from track color, white text
• light background, no text background, text colored from track color

A way to choose font, at least globally, could be added if requested. It can at minima be made by simple modding of the interface.



Best,

[alienmindarts]

I imagine in the recent future this workflow combined with Eleven Labs text to speech, but everything inside reaper using API. This will be amazing!

Great workflow! Merci!

[X-Raym]

@alienmindarts
Thx glad it can inspire you about other workflow!

Though I would rather have human do the text to speech for dubbing, that is where all the fun is 😉 (IA do not nees rythmo antway ^^)

But for speech to text, you already have scripts project for this !

• ReaWhisper v0.2.2 - audio multilingual speech recognition to text items
• ReaSpeach (newer)

[VES DROP]

Hi X-Raym,

I have bought your amazing script, it's awesome, bandrythmo in realtime !

I have attached a screenshot to show you that the ?=theme=light doesn't work.
I have tried with Firefox, LibreWolf and here with Vivaldi.
Maybe my url is uncorrect ?

And for optimisation, I have used
Script: Lokasenna_Create action to open a file... .lua to open Vivaldi directly from Reaper.
And next to it,
Script: X-Raym_Convert selected tracks to rythmoband web interface_background.lua
and this workflow is very pleasing.

Thank you for your response and for this tool !

[X-Raym]

@VES DROP
Thanks for your purchase, you are the first and only one so far 🤘


I perosnnaly used Script: acendan_Auto generate scripts to open web interfaces.lua to generate an action for the rythmo band. I didn't put the trick to not flood the page with information, but maybe I should if it is useful !


EDIT: just added a paragraph about this.

I have attached a screenshot to show you that the ?=theme=light doesn't work.

Oops typo.

the correct format would be ?theme=light

it's awesome, bandrythmo in realtime !

Please spread the word

Note: your Dumbledore dubbing seems very promising ^^

[VES DROP]

Ok, everything works fine with ?theme=light !

Maybe, to avoid being asked by future users, add the notification that the dark mode (like dark reader or other extension) has to be unchecked to get the light theme.
Same, we can zoom in and out to adjust the scale of the font in the web browser, which very cool.

For now, I would say that the scrolling speed adjustment option would be very useful depending on the speed of the scenes' dialogues.
Moreover, I have witnessed some slight random stutterings, I am picky about this because I want to capture the window to make bandrythmo videos.

Apart from that, everything is great and simple to use !
If I have any other feedback or suggestion, I will tell you then !

[X-Raym]

Maybe, to avoid being asked by future users,

I'll wait a bit and see if there is any other users. ^^

add the notification that the dark mode (like dark reader or other extension) has to be unchecked to get the light theme.

Ah yes of course, I would expect though that user having browser extension are aware of such consideration.

Same, we can zoom in and out to adjust the scale of the font

More precisely, the mouswheel in/out wasn't meant to adjust font size, but "time duration displayed in window", so font size is calculated based on that, in relation to the browser window size. So technically it isnt a zoom incrementation feature, but a time duration adjustement feature. This is why shrinking the window will lead to font size adjustement.

Moreover, I have witnessed some slight random stutterings, I am picky about this because I want to capture the window to make bandrythmo videos.

I'm very picky about this as well, and web interface is definitely where I see the less trouble. Video processor and reascript weren't smooth enough IMHO.



It worths noticing that the reaper window has a slow refresh rate compared browser so sometimes things seems out of sync by one frame, but I would rather trust the web interface. :P
I wonder if some plugins can cause some project play lag which make things out of sync, but the web interface has ways to control the sync and adjust if necessary if shift is longer than 1 frame duration approx (if it was out of sync, this may trigger a small stutter). Also, PC performance will matter a bit of course. I didn't personally noticed issue, but I would for sure need to test it more to see if they are some performance edge cases, like with many items, or many tracks, or things that.

Apart from that, everything is great and simple to use !

Many thanks for your detailed feedback ! And glad to know that despite having minimal in app documentation and some tricks to overcome some REAPER limitations, it can be as satisfying as promised !


Have fun with it !

[VES DROP]

Hi X-Raym, hope you are well !

I'm trying to change the rythmoband font to make it prettier but I can't find the lines to change in the .lua and .json.
How to change the rythmoband font?

I post in the forum and not directly to share the information with everybody

And by the way, I found the solution to capture the rythmoband without any image jerkiness: you have to capture the browser source directly. In addition, it allows you to capture at the resolution you want.

Thanks by advance for you help !

[X-Raym]

@VES DROP
Hi !


For now it has now user-friendly way to customize font (as it was not requested so far), so any customization will be lost at script update. Though it is easy to change if needed). Simply replace Arial in the file REAPER USER RESOURCE/reaper_www_root/X-Raym_Rythmoband.html on the

in the line

ctx.font = "bold 100px Arial"

I may add something later, maybe based on a custom URL query, to allow easy change.

I found the solution to capture the rythmoband without any image jerkiness: you have to capture the browser source directly

Oh so the jerkiness was just in the video capture ?
how do you capture video from "browser source" at "any resolution" ?

[VES DROP]

Don't worry about the font change, this solution in editing the .html is fine !

For the browser source capture, it is directly in OBS (see attachmented images).
Add a web browser source, put the reaper bandrythmo URL and choose the resolution of the window (and you can configure the capture at 60 fps if needed)
With this method, we can have a great quality capture !

Hope this helps and again, thank you very much for your help !

[X-Raym]

@VES DROP
Extremely interesting, I will probably put infos about that on the script page after testing.



It may be more efficient than using my after effects based workflow (a template replicating the rythmo band with a script to convert reaper text items to after effects layers), as it is way more flexible to edit in reaper than AR. A simple screen capture is less heavy than a video render.

[X-Raym]

@VES DROP
Can you please tell me what font you find better and paste a screenshot here ?
Thx !

[VES DROP]

Capturing the light theme web source is great, we can edit the color (colorize then adjust the hue with video processor) to make it more appealing and more in line with the original video (like in the screenshot).



You can see my setup, I use the web browser in the bottom of the window and Reaper at the top.
Reaper save the no fullscreen mode with the size and location of the windows in the screenset so I have saved one with this configuration.

For the font, I use Calibri because it is more rounded than arial (formal but less angular, more versatile) and more readable with small characters. Moreover it is a native windows font.

And I confirm that the capture needs to be at least 50fps to have a smooth video (and same, export the final video at 50fps).

Is that you plan to update your script ?

[X-Raym]

@VES DROP
Looks nice indeed,


So I pushed a little update, v1.0.8

+ font_name URL query to customize font
# Calibri as default on Windows

Note: if you already have another query like

?theme=ligth

, you have to chain the query using the & character, like this:

?theme=ligth&font=font_name

.

[X-Raym]

I have documented the video export workflow:


https://www.extremraym.com/en/downlo...ure_and_Render

[X-Raym]

@VES DROP
Je suis très curieux de savoir ce que fait cette histoire de cowboy dans harry potter 🤠🪄

[VES DROP]

Hi again X-Raym !

The documentation of the video export workflow is great and to the point.

The 1.0.8 update with the font name in the URL is awesome !
It will be cool to customize the font to match with the ambiance of the scene, for bandrythmo youtube videos.
Of course, Calibri remains the go to for dubbing because of its readibility.

Here is the link of the Harry Potter video, hope you will like it 😅
https://youtu.be/Nvwa7OIPBFk

Of course, all is done with Reaper 🤘

[X-Raym]

@VES DROP
haha I wasn't ready for this harry potter dubbing 😅


Well, good if you have fun with the script and if it helps you making new videos 😉


Cheers !

[dbncreation]

Hi X-Raym !
Your script seems awesome !
I'm about to buy it for my school and was wondering if it's possible to manage one very important thing in dubbing work : offs and semi-offs ? In that case we need to underline words that are off the camera... Can we do that ?
And regarding the fonts, can we use any font (professional voice talents use to work with handwriting-like fonts rather than "computer" fonts)
Thanks in advance

[X-Raym]

@dbncreation
Hi, Thanks !

Originally Posted by dbncreation

offs and semi-offs ?

Can you screenshot how it should look ?

Originally Posted by dbncreation

can we use any font (professional voice talents use to work with handwriting-like fonts rather than "computer" fonts)

yes you can customize font. See instructions here.


Note that not all pro dubber like handwriting font :P Some prefer not use font at all ! Pure handwriting. I just changed to Calibiri, as adviced by a pro studio, it is a bit better than previous screenshot.


If you are a teacher or school administrator, I would love to hear more about your project (is it for a whole school ?), dont hesitate to contact me in PM to see what pricing could be considered (but feel free to buy it for you on your own for testing).


Cheers !

[dbncreation]

Originally Posted by X-Raym

Can you screenshot how it should look ?

Yes of course, in the first screenshot you can see some part of the lines that are underlined, meaning that the character speaks off the camera.

And in the second one, some words are "dash-underlined", meaning that we can see the character but not its lips.

These two informations are crucial for the voice talents when they dub, so they know that they have some freedom in their interpretation and breathes...

Also, the font used here is one of the most usual in pro dubbing studios (in France).

I send you a PM to talk about my project

Thanks !

[X-Raym]

@dbncreation
What would be the best way to encode it ?
I'm thinking of HTML inspired markup like

This next word is <u>underline</u>

Need to determine meaningful but concize markup names like U and DU for eg (underline, dash-underline)

What is the name of the font ?
I dont plan to put it as default but just write it on the doc page.

[dbncreation]

Originally Posted by X-Raym

What would be the best way to encode it ?

For me, it would be great to directly underline words or part of words in Reaper's text items. Is it even possible ?

What is the name of the font ?

This is the font used by Mosaic software... it's maybe proprietary. I need to search the info

[X-Raym]

@dbncreation
Item notes are just text, no customization on anything.


A custom viewer (like the rythmoband is to some extend, but could be a custom note editor in reaper) can process text before display, but style as to be encoded somehow.
HTML or BBcode markup inspiration would be the most common approach, just like in subtitles files actually.

[X-Raym]

@dbncreation
I was exploring how to do underline text in Canvas HTML (the tech used by this plugin) and seems hardcore to do in the context of this rythmo band, as everything will need to be coded scratch.


But I think I just get a very nice workarround idea: using a secondary text item above the first one, with a specific text (like <u> ) to tell to mark a line during the duration of the item.


Here is preview of what these underline items would look like in arrange view (with overlapping item lanes or without): it would just be a matter of setting in/out point.




I think this would be way easier to implement, + it allows to position underline mark at perfect frame position. Downside is that the underline line may not be perfectly vertically aligned with the text (though manual adjustement can be made if needed). Plus side is that it may be quicker to copy paste these underline items to create underline lines that to actually edit the items text notes.


What do you think ?


EDIT: Here is a quick demo (would still need few adjustement):



I think it is a pretty elegant solution

[dbncreation]

What do you think ?

Totally agree ! And this solution seems very easy to use, nice workaround !

I'm impatient to try it out

[X-Raym]

v1.1 Update:

• Underline text items support in v1.1

Really required out of the box, but seems to works very smoothly !


I implemented the dash in a very simple way for now (you just put the number of desired dash yourself using underscore and spaces), may enhance that in the future if really required.

[dbncreation]

Awesome ! Thank you X-Raym !

I'm gonna make some tests and let you know