The warning comes after a synagogue was hit by an arson attack overnight, a Jewish community body said.