Have you tried checking these preferences?
I have it set to not close, because my driver is independent of other applications. If you use ASIO, you might have some issues where other applications won't be able to play sound while Reaper is using the driver.