(The people of) Bani Salama intended to shift near the mosque (of the Prophet) but Messenger of Allah ﷺ disliked to see Medina vacated and said, "O the people of Bani Salama! Don't you think that you will be rewarded for your footsteps which you take towards the mosque?" So, they stayed at their old places.
أَنْ يَتَحَوَّلُوا إِلَى قُرْبِ الْمَسْجِدِ فَكَرِهَ رَسُولُ اللَّهِ ﷺ أَنْ تُعْرَى الْمَدِينَةُ وَقَالَ يَا بَنِي سَلِمَةَ أَلاَ تَحْتَسِبُونَ آثَارَكُمْ فَأَقَامُوا