Analysis by more than 150 political scientists finds proportion who back such parties has increased nearly fivefold since 1995