‘The phone would ring and it would be Mike Scott from the Waterboys or Bono from U2. Everyone wanted to talk to my father’