France has shut down dozens of mosques, Islamic schools this year
During a press conference, the minister confirmed that a mosque and private school in the Heralt area were closed last month, along with an "organisation" and nine shops in other regions.
The minister also called for the expulsion of hundreds of foreign nationals from France.
"We must expel 231 foreigners from French territory, who are residing there illegally, and are being pursued on charges of extremism, including 180 in prison," he said.
The move comes amid heightened tensions between France and its Muslim community.
Last week, French President Emmanuel Macron described Islam as a religion "in crisis" worldwide and said the government would present a bill in December to strengthen a 1905 law that officially separated the church and state in France.
He announced the stricter government oversight of schooling and better control over foreign funding of mosques.
Macron also warned against the creation of a "counter-society" holding its own laws among France's Muslims.
Read also: An unpopular Macron invokes the anti-Muslim playbook
Scholars at Egypt's prestigious Sunni Islamic institution, Al-Azhar, denounced the remarks as "racist" and accused the French leader of spreading "hate speech".
"He made false accusations against Islam, that have nothing to do with the true essence of this religion," Al-Azhar's Islamic Research Academy said in statement.
"Such racist statements will inflame the feelings of two billion Muslim followers" around the world, and block the path to constructive dialogue, the statement added.
Al-Azhar said making "false accusations about Islam or other religions, such separatism and isolationism" went against the actual "reality of what these religions call for".
It also condemned those who exploit or employ "religious texts to achieve unsavoury purposes".
Turkey's President Recep Tayyip Erdogan also hit back at the French leader.
"Macron's statement that 'Islam is in a crisis' is an open provocation beyond disrespect," Erdogan said in a televised address.
"Who are you to talk about the structuring of Islam?" he asked, accusing him of "impertinence".
Erdogan advised Macron "to pay more attention while talking about issues that he is ignorant about".
"We expect him to act as a responsible statesman rather than act like a colonial governor."
Turkey is a majority Muslim - but secular - country which is a part of NATO but not the EU. Its membership bid for the European body has stalled for decades over a range of disputes, both domestic and foreign policy-related.
Follow us on Facebook, Twitter and Instagram to stay connected