Number of EU citizens in the UK has dropped significantly after Brexit