John Swinney was accused of 'overseeing the death' of the North Sea as voters went to the polls in a referendum on the oil and gas industry.