Does this happen in both directions?
If not, I would put it down to the direction the track has been laid in.
Also check that each section of track is laid in the same direction.
I have overcome this by putting in invisible speed signs to increase the speeds