Anas bin Malik reported on the authority of his father, The Apostle of Allaah ﷺ said “ You left behind some people in Madeenah who did not fail to be with you wherever you went and whatever you spent (of your goods) and whatever valley you crossed. They asked Apostle of Allaah ﷺ how can they be with us when they are still in Madeenah? He replied “They were declined by a valid excuse.”
أَنَّ رَسُولَ اللَّهِ ﷺ قَالَ لَقَدْ تَرَكْتُمْ بِالْمَدِينَةِ أَقْوَامًا مَا سِرْتُمْ مَسِيرًا وَلاَ أَنْفَقْتُمْ مِنْ نَفَقَةٍ وَلاَ قَطَعْتُمْ مِنْ وَادٍ إِلاَّ وَهُمْ مَعَكُمْ فِيهِ قَالُوا يَا رَسُولَ اللَّهِ وَكَيْفَ يَكُونُونَ مَعَنَا وَهُمْ بِالْمَدِينَةِ فَقَالَ حَبَسَهُمُ الْعُذْرُ