The former head of the Metropolitan Police has admitted that the force failed to control a controversial undercover unit which used covert techniques for decades to spy on political activists.