Jersey's Economic Development Minister has told the BBC that workers' rights may have to take 'second place' to economic growth.