The drop has been largely driven by a rise in the number of people not actively seeking work.