Yes you can copy the data folder over to the new installation. I believe the 'export configuration' feature accomplishes the same thing and then you just 'import' it into the new Reaper installation.
I haven't used this feature yet, so I recommend checking the
User Guide for specifics.
So whichever you prefer.