Hi Rog,
What you are seeing is correct if you've adjusted the track height or leveled out the spline point with the adjustment tool.
Try moving the lever a bit closer to the junction, or it maybe sitting on a spline joint that's not connected to a junction. I've had levers, speed signs, and other trackside objects move around if I've added in a spline point.
John