That's exactly the problem
With the nut loose, the lip that presses against the ball when you close the latch isn't tight to the ball. You need to put the trailer on the hitch, close the latch, then tighten that nut until the lip is just snug to the ball...not cranked down hard.
If the nut is...