Pakistan had announced a huge drive to repatriate foreigners without visas, mostly the roughly 4 million Afghans who crossed the border throughout the conflicts