I find if I lightly tap A and D, alternating and not rapidly, and just play with it for a minute or two, it fixes.
There's definitely a bug there, but whenever it is smooth it looks really nice.
So I found out that the loop in Play Solo runs at an ever 30 ticks per second, when testing on a server it runs at 7 ticks.
I'm going to try and move it to the run service and use Bind to render stepped.