PM says talking about changing the relationship with the bloc would not be divisive but ‘can start to bring people together’