Anas bin Malik reported on the authority of his father, The Apostle of Allaah ﷺ said “ You left behind some people in Madeenah who did not fail to be with you wherever you went and whatever you spent (of your goods) and whatever valley you crossed. They asked Apostle of Allaah ﷺ how can they be with us when they are still in Madeenah? He replied “They were declined by a valid excuse.” (Using translation from Abū Dāʾūd 2508)
قَالَ رَسُولُ اللهِ ﷺ لَقَدْ تَرَكْتُمْ بِالْمَدِينَةِ رِجَالًا مَا سِرْتُمْ مِنْ مَسِيرٍ وَلَا أَنْفَقْتُمْ مِنْ نَفَقَةٍ وَلَا قَطَعْتُمْ مِنْ وَادٍ إِلَّا وَهُمْ مَعَكُمْ فِيهِ قَالُوا يَا رَسُولَ اللهِ وَكَيْفَ يَكُونُونَ مَعَنَا وَهُمْ بِالْمَدِينَةِ؟ قَالَ حَبَسَهُمُ الْعُذْرُ