20N.m does not sound tight enough, at that tension it will fall out. You need to be doing it up to about 180N.m

I would usually do them up with a good impact gun with a good air compressor