The metal is shiny on the axle next to the hub, if you didn't polish it then I would say the hub is not fully seated. The fact the nut barely made it on enough to put in a cotter pin tells me there are problems. You should never hammer on bearings, races, or seals and if you did, take everything...