Gordon Brown struggles to relate to, and make an emotional bond with, fellow Labour MPs and Ministers.