India's Prime Minister Narendra Modi has faced backlash for calling Muslims "infiltrators" at an election rally in India.