Anthony Albanese has pushed back against criticism that migration levels are too high, as the government faces accusations it has failed to meet its own targets.