Begged by his mother to go somewhere his behaviour wouldn’t ‘show so much’, the future novelist, aged 19, embarked on a lifetime of travel and rarely visited Britain again