Figured out the problem.
My Keyboard was sending midi on channel 15, and Knifonium and Oberhausen (+ some other PA stuff) can only receive midi on channel 1. Midi input through Scaler sends midi out on channel 1, that's why I could only get them to work with Scaler on my Input FX.
Works without Scaler now my keyboard is set to channel 1.