midi delay, only on playback. Possible?

[PatrickB]

Hello
Is it possible to have a midi delay that is only heard upon playback and not while recording...without having to toggle the effect on and off between takes?

Here's why:
When I record certain sampled instruments, for example a Rhodes piano using Kontakt, I tend to compensate for the latency I'm hearing (3.9ms). As a result, the take sounds good as I'm recording, but upon playback it sounds slightly rushed.
If I either nudge it or use a midi delay upon playback to move my performance back 3.9ms, it feels right.
I use the JS Midi Delay to do this, but would prefer not having to toggle it on and off between takes to assess the performances...to improve workflow.
I would also like to keep the track as a midi track for editing flexibility.
Any solutions? Thanks