The Great British Bake Off presenter says he has not been in contact with the convicted rapist "for many years".