Devils can’t open windows and doors when you keep them shut, this works for devils from jinns and mankind alike. So shut the open doors or windows (like, don’t look and don’t start a chat that you don’t know where it’s gonna take you) if you don’t want to be provoked that happens more often through people.

In the following a Hadith of prophet Mohamed peace be upon him giving advice regarding jinns:

When night falls, restrain your children (from going out) because at such time the devils (jinns) spread about. After a period of time has passed, let them be. Shut your doors and mention Allah’s name, for verily the devil does not open a shut door, tie up your water-skins and mention Allah’s name, cover your vessels with anything and mention Allah’s name and put out your lamps.

إِذَا كَانَ جُنْحُ اللَّيْلِ – أَوْ أَمْسَيْتُم – فَـكُفُّوا صِبْيانَـكُم، فَإِنَّ الشَّيَاطِينَ تَنْتَشِرُ حِينَئِذٍ، فَإِذَا ذَهَبَ سَاعَةٌ مِنَ اللَّيلِ فَخَلُّوهُمْ، وَأَغْلِقُوا الأَبْوَابَ وَاذْكُرُوا اسْمَ اللَّهِ؛ فَإِنَّ الشَّيطَانَ لاَ يَفْتَحُ بَاباً مُغلَقاً، وَأَوْكُوا قِرَبَكُمْ، وَاذْكُرُوا اسْمَ اللَّهِ، وَخَمِّرُوا آنِيَتَكُم، وَاذْكُرُوا اسْمَ اللَّهِ، وَلَوْ أَنْ تَعْرُضُوا عَلَيْهَا شَيْئاً، وَأَطْفِئُوا مَصَابِيحَكُمْ.

Reference:
Al-Bukhari
Hisn al-Muslim 267
https://sunnah.com/hisn:267

Further more in the Quran it’s mentioned how to behave to protect own self from the provocation of the devils and some verses in regards are in the following:

7:199 Al-A'raaf

‎خُذِ الْعَفْوَ وَأْمُرْ بِالْعُرْفِ وَأَعْرِضْ عَنِ الْجَاهِلِينَ

Take what the pardon, enjoin what is good, and turn away from the ignorant.

7:200 Al-A'raaf

‎وَإِمَّا يَنْزَغَنَّكَ مِنَ الشَّيْطَانِ نَزْغٌ فَاسْتَعِذْ بِاللَّهِ ۚ إِنَّهُ سَمِيعٌ عَلِيمٌ

And if an evil suggestion (provocations) comes to you from Satan, then seek refuge in Allah. Indeed, He is Hearing and Knowing.

7:201 Al-A'raaf

‎إِنَّ الَّذِينَ اتَّقَوْا إِذَا مَسَّهُمْ طَائِفٌ مِنَ الشَّيْطَانِ تَذَكَّرُوا فَإِذَا هُمْ مُبْصِرُونَ

Indeed, those who fear Allah - when an impulse touches them from Satan, they remember [Him] and at once they have insight.

7:202 Al-A'raaf

‎وَإِخْوَانُهُمْ يَمُدُّونَهُمْ فِي الْغَيِّ ثُمَّ لَا يُقْصِرُونَ

But their brothers - the devils increase them in error; then they do not stop short.