Delhi calls comment ‘inappropriate’ as critics warn it could deepen fears among immigrants