The much-loved celebrity became a co-owner and shareholder in the bakery business and, after news of the closure came to light, he simply said 'gutted isn't the word'