Very bad performance when remoting on UE 5.1 (In Editor)

[shukenmg]

When remoting the game tick time increases dramatically, the Self ms becomes far too high.

Also, if I add a few objects into the scene the fps drops even more and the ms on Self increases a lot.

With remoting (Vr preview):

With remoting and a few objects in the scene:

Without Remoting (Play in Editor) (with or without objects in the scene doesn't change the fps much):

Remoting settings:

Tested on a packaged game with the same results.

Edit: after more testing, it seems the issue is only in the editor.