Sir Keir Starmer has vowed to fight on despite growing calls for him stand down from his own MPs and the threat of a leadership contest.