Eldest child of writer Margaret Drabble and actor Clive Swift. He appeared as a teenager with his father (and sister Rebecca Swift) in the series Clayhanger (1976) but never took up acting professionally, instead pursuing an academic career.
Elder brother of TV presenter and garden designer Joe Swift.
His aunt (on his mother's side) is writer A.S. Byatt and his uncle (on his father's side) is actor David Swift. His cousin (David's daughter) is actress Julia Swift.